-- Logs begin at Fri 2022-09-09 05:49:15 UTC, end at Fri 2022-09-09 06:48:25 UTC. -- Sep 09 06:20:34.253380 dv-cinder-852209-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 06:20:34.260847 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 06:20:34 2022] *** Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: nodename: dv-cinder-852209-16-iscsi Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: machine: x86_64 Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: clock source: unix Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: pcre jit disabled Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: detected number of CPU cores: 4 Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: current working directory: / Sep 09 06:20:34.262835 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: detected binary path: /usr/bin/uwsgi-core Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: your processes number limit is 47680 Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: your memory page size is 4096 bytes Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: detected max file descriptor number: 2048 Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: lock engine: pthread robust mutexes Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: thunder lock: enabled Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 06:20:34.263522 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 06:20:34.302901 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: Python main interpreter initialized at 0x561d041189c0 Sep 09 06:20:34.302901 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: python threads support enabled Sep 09 06:20:34.302901 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: your server socket listen backlog is limited to 100 connections Sep 09 06:20:34.302901 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: your mercy for graceful operations on workers is 90 seconds Sep 09 06:20:34.303287 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 06:20:34.303380 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: *** Operational MODE: preforking *** Sep 09 06:20:34.303611 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: *** uWSGI is running in multiple interpreter mode *** Sep 09 06:20:34.303611 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: spawned uWSGI master process (pid: 105503) Sep 09 06:20:34.303819 dv-cinder-852209-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 06:20:34.305362 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: spawned uWSGI worker 1 (pid: 105504, cores: 1) Sep 09 06:20:34.305362 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: spawned uWSGI worker 2 (pid: 105505, cores: 1) Sep 09 06:20:34.305362 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 06:20:34.967166 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 06:20:34.968091 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 06:20:36.052821 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:20:36.052821 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: from cryptography.utils import int_from_bytes Sep 09 06:20:36.053420 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:20:36.053420 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: from cryptography.utils import int_from_bytes Sep 09 06:20:36.056139 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:20:36.056139 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: from cryptography.utils import int_from_bytes Sep 09 06:20:36.056593 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:20:36.056593 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: from cryptography.utils import int_from_bytes Sep 09 06:20:38.537903 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:20:38.538495 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:20:38.538691 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:20:38.539052 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:20:38.539313 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:20:38.539723 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.539909 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:20:38.540305 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.540398 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:20:38.540490 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.540668 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.540765 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:20:38.540999 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.541104 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:20:38.541286 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:20:38.541381 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.541621 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.541716 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.541942 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542035 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542279 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542410 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542578 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542688 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542855 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.542959 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543179 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-16-iscsi {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543273 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543507 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543621 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543840 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.543946 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544262 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544443 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544542 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544771 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.544869 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545078 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545168 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-16-iscsi {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545394 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545485 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545703 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.545891 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.546061 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.547113 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.547721 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.547813 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548437 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548571 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548840 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548840 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548985 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.548985 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549126 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549220 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549312 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549391 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549467 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549533 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549605 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549677 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549743 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549816 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.549883 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550007 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-16-iscsi {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550150 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550331 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550445 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550645 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550760 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.550962 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.551075 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.551321 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.551432 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.551701 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.551805 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-16-iscsi {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552012 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552101 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552334 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552422 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552660 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552768 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.552967 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553059 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553295 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553402 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553627 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.553938 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554027 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554255 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554354 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554557 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554651 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554863 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.554950 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555181 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555278 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555487 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555593 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555818 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.555914 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556123 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556222 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556373 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556459 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556680 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.556767 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557000 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557095 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557319 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557407 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557634 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557727 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557883 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.557970 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558132 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558238 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558449 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558549 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558767 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.558857 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559075 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559169 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559361 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559456 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559698 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559786 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.559948 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560050 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560272 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560384 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560575 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560661 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560881 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.560967 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561187 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561272 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561495 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561582 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561804 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.561903 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562115 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562201 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562419 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562504 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562727 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.562823 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.563049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.563135 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.563358 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.563443 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564253 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564409 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564588 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564732 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564880 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.564961 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565188 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565274 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565506 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565582 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565827 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.565901 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566133 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566229 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566438 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566516 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566744 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.566821 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567063 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567148 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567430 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567657 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567820 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.567961 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568092 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568233 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568506 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568635 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568766 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.568902 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569032 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569174 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569304 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569444 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569575 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569717 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.569882 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570022 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570160 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570297 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570426 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570559 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570690 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.570866 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571004 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571174 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571329 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571572 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571705 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571843 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.571978 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572111 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572252 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572390 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572522 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572656 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572795 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.572957 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573101 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573278 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573410 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573595 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573736 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.573900 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574040 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574210 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574342 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574516 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574646 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574822 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.574917 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575139 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575237 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575534 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575774 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.575876 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576093 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576183 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576400 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576487 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576705 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.576801 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577025 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577112 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577332 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577418 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577636 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577730 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.577953 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578041 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578254 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578340 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578562 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578657 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578872 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.578956 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.579204 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.579309 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.579515 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.579707 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.579869 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580026 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580133 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580380 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580485 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580707 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.580808 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581008 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581094 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581312 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581708 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581867 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.581957 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582175 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582266 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582486 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582590 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582790 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.582875 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583097 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583186 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583399 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583492 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583726 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.583814 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.584051 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.584135 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.584378 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.584471 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.584688 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.584773 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.584999 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.585084 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.585309 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.585401 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.585631 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:20:38.585716 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.585971 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586073 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586283 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586370 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586596 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586688 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.586920 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587015 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587233 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587318 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587581 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587671 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587875 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.587973 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588192 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588278 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588510 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588602 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588838 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.588932 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589154 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589260 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589468 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589554 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589785 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.589884 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590096 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590182 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590413 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590499 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590742 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.590835 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591063 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591149 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591372 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591464 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591721 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.591830 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592038 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592127 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592361 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592448 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592684 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.592772 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593005 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593198 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593318 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593404 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593629 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593717 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.593941 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594026 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594290 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594383 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594603 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594697 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.594983 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.595137 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.595363 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.595523 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.595747 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.595837 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596065 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596151 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596414 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596510 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596732 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.596819 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597051 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597143 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597365 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597461 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597677 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.597786 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598011 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598102 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598326 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598421 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598651 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598737 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.598967 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599052 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599278 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599373 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599727 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.599952 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600081 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600246 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600345 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600557 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600644 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600864 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.600959 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601166 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601253 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601469 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601598 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601779 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.601868 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602082 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602172 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602398 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602485 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602712 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.602798 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603019 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603106 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603327 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603412 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603661 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.603968 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604063 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604281 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604374 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604591 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604686 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604896 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.604983 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605206 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605292 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605516 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605614 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605820 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.605906 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606129 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606221 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606441 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606534 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606745 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.606838 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607056 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607359 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607458 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607687 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.607775 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608000 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608086 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608312 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608408 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608617 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608702 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.608926 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609012 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609236 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609323 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609541 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609627 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609857 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.609944 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.610165 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.610253 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.610992 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.611123 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.611312 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.611528 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.611713 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.611850 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612068 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612156 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612386 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612486 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612700 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.612794 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613092 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613178 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613405 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613500 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613708 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.613794 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614012 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614099 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614317 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614450 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614631 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614724 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.614933 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615019 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615238 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615337 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615562 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615651 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615863 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.615949 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616165 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616260 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616476 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616568 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616780 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.616872 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617171 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617385 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617472 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617688 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617774 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.617997 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618089 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618310 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618398 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618623 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618708 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.618934 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619021 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619238 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619332 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619563 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619663 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619905 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.619991 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620215 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620300 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620525 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620619 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620836 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.620922 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621147 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621236 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621456 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621552 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621775 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.621903 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622085 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622206 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622401 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622563 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622713 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.622800 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623025 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623110 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623333 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623420 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623677 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623768 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.623983 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624068 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624298 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624387 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624613 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624710 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.624939 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625034 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625253 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625341 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625573 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625658 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625879 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.625964 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.626273 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.626415 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.626623 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.626792 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.626957 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627046 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627278 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627366 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627631 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627720 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.627951 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628052 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628259 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628344 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628574 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628660 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628884 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.628980 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629198 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629284 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629507 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629601 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629822 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.629917 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630125 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630219 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630439 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630526 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.630846 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631077 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631165 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631385 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631471 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631731 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.631870 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632040 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632130 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632353 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632439 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632663 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.632972 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633059 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633275 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633368 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633581 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633675 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633890 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.633977 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634203 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634300 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634513 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634643 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634826 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.634912 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635127 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635221 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635434 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635519 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635763 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.635852 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636068 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636167 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636371 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636459 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636682 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636766 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.636989 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637084 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637297 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637383 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637606 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637691 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.637915 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638015 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638218 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638303 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638520 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638607 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638842 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.638938 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639148 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639242 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639451 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639537 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639776 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.639873 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640078 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640164 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640399 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640485 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640717 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.640804 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.641023 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.641108 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.641328 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.641413 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642203 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642348 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642526 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642629 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642874 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.642974 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643185 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643285 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643494 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643627 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643838 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.643942 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644155 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644245 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644467 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644555 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644781 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.644893 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645090 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645178 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645399 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645495 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645709 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.645809 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646023 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646119 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646329 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646424 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646640 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646737 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.646947 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647036 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647253 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647342 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647579 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647677 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647901 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.647990 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.648212 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.648470 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.648576 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.648804 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.648894 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649115 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649203 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649433 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649529 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649753 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.649849 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650079 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650317 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650409 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650651 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650752 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.650969 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651059 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651289 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651379 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651630 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651732 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.651940 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652039 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652290 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652393 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652555 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652650 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652860 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.652951 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653166 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653257 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653472 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653567 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653784 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.653880 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654086 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654181 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654389 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654487 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654693 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.654797 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655002 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655105 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655307 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655406 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655641 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655750 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.655949 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656067 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656255 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656357 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656563 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656684 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656870 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.656995 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.657186 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.657821 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658054 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658154 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658355 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658446 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658662 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658753 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.658986 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659091 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659301 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659392 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659629 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659721 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.659938 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660036 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660243 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660347 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660586 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660678 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660892 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.660989 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661211 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661296 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661518 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661616 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661817 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.661921 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662125 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662224 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662435 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662538 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662736 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.662825 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663045 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663143 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663353 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663449 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663678 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663771 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.663985 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664084 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664288 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664391 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664590 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664688 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664888 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.664994 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665195 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665293 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665499 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665588 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665800 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.665898 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666116 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666206 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666406 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666496 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666708 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.666798 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667009 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667316 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667405 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667650 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667745 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.667943 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668031 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668243 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668342 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668544 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668634 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668846 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.668940 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669151 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669247 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669458 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669546 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669758 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.669846 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670064 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670160 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670370 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670458 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670669 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670757 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.670970 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671071 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671280 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671416 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671600 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671695 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.671906 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672017 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672213 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672520 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672648 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672830 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.672990 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673152 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673245 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673455 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673542 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673757 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.673853 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674060 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674150 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674364 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674454 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674675 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674766 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.674979 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675077 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675281 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675373 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675604 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675710 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.675911 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676001 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676214 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676383 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676525 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676621 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676831 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.676920 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677131 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677231 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677434 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677523 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677737 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.677825 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678038 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678134 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678363 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678452 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678675 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678764 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.678978 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679076 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679290 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679386 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679618 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679723 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.679943 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680033 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680257 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680347 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680570 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680659 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680875 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.680965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681190 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681279 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681501 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681592 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681812 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.681902 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682116 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682205 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682420 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682518 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682728 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.682829 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683037 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683129 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683348 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683446 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683686 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683778 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.683995 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684100 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684400 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684608 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684697 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.684922 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685012 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685231 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685374 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685540 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685630 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685849 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.685938 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686158 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686255 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686466 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686555 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686775 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.686870 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687084 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687181 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687391 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687487 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687724 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.687815 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688028 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688118 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688337 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688427 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688673 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688770 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.688978 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689069 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689303 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689478 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689614 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689794 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.689919 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690103 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690229 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690418 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690533 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690733 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.690844 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691042 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691152 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691369 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691596 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691704 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.691911 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692002 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692222 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692312 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692527 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692628 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692842 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.692980 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693156 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693252 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693470 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693577 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693781 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.693894 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694087 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694208 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694503 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694590 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694814 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.694898 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695123 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695210 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695434 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695523 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695764 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.695870 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696067 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696161 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696377 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696464 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696699 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.696786 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697003 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697090 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697307 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697395 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697610 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697696 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.697930 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698025 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698235 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698329 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698556 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698650 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.698951 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699045 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699262 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699349 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699580 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699669 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.699909 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700006 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700220 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700314 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700542 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700636 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700900 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.700993 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701223 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701317 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701554 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701673 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701851 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.701961 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.702165 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.702260 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.702474 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.702561 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.702801 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703041 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703214 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703316 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703510 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703740 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.703832 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.704044 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.704666 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.704999 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705147 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705333 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705522 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705653 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705795 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.705976 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.706109 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.706393 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.706746 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.706974 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707065 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707286 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707377 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707632 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707744 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.707952 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708049 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708258 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708355 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708565 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708664 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708878 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.708975 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709182 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709282 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709487 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709591 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709810 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.709901 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710117 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710207 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710429 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710527 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710740 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.710830 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711048 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711145 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711351 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711445 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711677 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.711777 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712002 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712092 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712307 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712398 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712618 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712706 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.712930 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713032 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713237 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713338 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713541 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713632 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713852 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.713943 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714159 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714248 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714471 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714559 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714775 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.714875 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715077 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715175 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715385 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715476 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715741 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.715893 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716042 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716139 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716353 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716441 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716659 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716822 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.716965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717056 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717270 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717360 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717605 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717703 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717910 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.717999 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718233 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718322 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718545 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718635 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718863 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.718952 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.719179 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.719267 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.719483 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.719614 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.719860 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.720438 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.720662 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.720751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.720968 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721147 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721272 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721475 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721566 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721805 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.721911 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722115 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722206 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722422 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722511 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722735 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.722825 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723042 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723130 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723347 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723458 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723687 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723780 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.723997 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724087 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724303 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724392 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724605 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724696 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.724904 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725003 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725228 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725317 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725535 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725632 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.725857 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726001 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726165 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726264 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726470 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726560 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726776 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.726866 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727081 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727180 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727401 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727491 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727740 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.727833 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728052 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728165 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728365 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728454 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728676 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728773 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.728985 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729084 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729298 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729387 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729611 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729711 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.729924 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730014 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730241 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730438 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730563 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730770 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.730868 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731085 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731175 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731400 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731491 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731738 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.731909 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732053 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732144 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732365 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732643 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732733 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.732975 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733065 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733286 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733392 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733600 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733712 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.733913 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734002 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734230 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734328 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734547 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734645 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734861 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.734951 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.735177 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.735269 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.735532 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.735662 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.735945 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736140 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736261 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736366 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736617 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736719 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.736932 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737024 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737241 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737336 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737557 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737648 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737874 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.737965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738189 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738288 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738509 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738600 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738823 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.738919 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739137 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739236 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739451 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739572 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739787 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.739890 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740100 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740191 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740414 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740517 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740730 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.740820 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741043 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741133 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741362 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741452 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741681 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741770 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.741995 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742086 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742308 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742397 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742622 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742712 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.742938 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743142 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743265 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743457 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743659 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743812 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.743957 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744138 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744277 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744464 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744598 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744778 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.744920 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.745100 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.745426 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.745517 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.745733 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.745835 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746037 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746124 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746350 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746451 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746659 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746752 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.746962 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747065 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747284 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747375 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747620 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747716 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.747924 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748244 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748334 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748553 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748652 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.748864 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749182 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749430 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749534 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749746 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.749835 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750070 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750160 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750393 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750490 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750708 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.750797 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.751052 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.751445 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.751564 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.751780 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.751879 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752087 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752188 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752501 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752714 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.752828 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753019 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753155 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753324 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753471 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753638 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753851 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.753958 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754085 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754241 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754398 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754550 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754719 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.754854 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755037 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755185 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755346 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755491 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755681 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755820 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.755999 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756126 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756320 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756441 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756627 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756727 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.756942 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757042 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757251 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757340 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757581 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757668 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757892 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.757980 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758193 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758279 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758498 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758583 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758800 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.758886 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759107 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759201 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759415 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759502 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.759841 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760059 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760152 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760374 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760461 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760677 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760765 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.760983 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761079 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761288 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761382 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761599 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761685 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.761923 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762010 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762237 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762380 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762541 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762633 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762867 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.762954 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.763174 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.763268 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.763483 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.763745 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.763833 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764076 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764174 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764401 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764495 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764739 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.764832 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765067 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765162 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765379 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765465 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765689 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765782 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.765998 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.766248 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.766357 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.766592 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.767182 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.767448 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.767657 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.767827 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.767964 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768225 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768312 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768544 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768639 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768859 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.768958 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769170 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769257 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769482 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769582 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769794 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.769881 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770105 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770193 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770418 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770514 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770730 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.770817 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771041 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771134 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771349 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771454 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771688 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.771778 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772008 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772094 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772324 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772431 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772635 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772737 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.772952 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773040 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773267 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773354 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773580 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773668 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773890 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.773975 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774195 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774289 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774502 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774595 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774815 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.774911 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775144 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775232 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775457 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775570 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775792 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.775892 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.776113 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.776428 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.776513 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.776740 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.776826 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777051 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777140 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777371 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777457 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777683 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.777778 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778006 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778093 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778315 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778400 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778631 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.778952 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779039 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779266 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779353 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779626 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779717 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.779960 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780048 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780280 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780367 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780605 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780699 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.780913 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781001 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781220 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781307 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781526 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781622 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781838 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.781925 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.782158 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.782295 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783061 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783219 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783399 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783595 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783752 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.783978 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784079 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784297 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784385 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784607 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784702 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.784916 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785017 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785224 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785310 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785530 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785617 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785849 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.785949 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786155 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786243 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786460 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786547 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786765 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.786875 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787067 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787162 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787370 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787507 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787699 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.787789 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788060 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788155 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788312 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788400 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788617 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788705 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.788920 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789007 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789223 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789319 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789525 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789613 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789832 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.789927 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790147 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790233 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790454 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790541 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790782 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.790877 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791075 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791175 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791386 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791474 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791718 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.791813 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792041 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792140 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792366 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792454 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792682 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792769 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.792996 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793136 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793311 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793630 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793732 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.793943 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794038 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794255 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794351 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794568 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794655 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794878 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.794966 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795191 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795276 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795517 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795639 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795859 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.795947 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796164 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796258 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796479 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796565 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796796 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.796891 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797108 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797201 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797423 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797519 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797733 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.797828 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798102 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798253 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798393 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798561 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798728 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.798886 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799204 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799455 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799583 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799813 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.799902 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800132 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800232 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800441 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800529 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800755 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.800844 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801072 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801159 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801386 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801474 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801702 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.801790 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802017 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802105 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802331 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802464 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802650 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802737 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.802966 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803053 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803287 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803630 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803722 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.803965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804066 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804296 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804382 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804608 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804694 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.804920 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.805014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.805228 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.805316 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.805471 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:20:38.805592 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.805909 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.806259 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.806595 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.806916 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.807232 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.807558 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:20:38.807809 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:20:38.961218 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Registered counter for database nova_api Sep 09 06:20:38.975306 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO dbcounter [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Registered counter for database nova_api Sep 09 06:20:38.984075 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:38.991330 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.003670 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_db.sqlalchemy.engines [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.010173 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writer thread running {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.048744 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.context [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c899fb98-16f2-46e4-8e27-e32c68678e5e(cell1) {{(pid=105504) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 06:20:39.052732 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:20:39.053211 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:20:39.054751 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:20:39.055462 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:20:39.055929 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:20:39.057912 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_concurrency.lockutils [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:20:39.059925 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Registered counter for database nova_cell0 Sep 09 06:20:39.064697 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Registered counter for database nova_cell1 Sep 09 06:20:39.068677 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.context [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c899fb98-16f2-46e4-8e27-e32c68678e5e(cell1) {{(pid=105505) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 06:20:39.071951 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.072659 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:20:39.073145 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:20:39.073607 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.074729 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:20:39.075469 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:20:39.075943 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:20:39.077958 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:20:39.079077 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.080976 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO dbcounter [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Registered counter for database nova_cell0 Sep 09 06:20:39.082941 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.085329 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO dbcounter [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Registered counter for database nova_cell1 Sep 09 06:20:39.092440 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_db.sqlalchemy.engines [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.096142 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_db.sqlalchemy.engines [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.099030 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writer thread running {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.229453 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO dbcounter [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Registered counter for database nova_cell0 Sep 09 06:20:39.239098 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG oslo_db.sqlalchemy.engines [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.242440 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writer thread running {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.243932 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writer thread running {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.251643 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO dbcounter [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Registered counter for database nova_cell0 Sep 09 06:20:39.260470 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_db.sqlalchemy.engines [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:20:39.265216 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writer thread running {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:20:39.584483 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:20:39.589046 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: WARNING keystonemiddleware.auth_token [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:20:39.591779 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:20:39.596469 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: WARNING keystonemiddleware.auth_token [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:20:39.940967 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:20:39.944541 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: WARNING keystonemiddleware.auth_token [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:20:39.946903 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: WARNING keystonemiddleware.auth_token [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:20:39.950504 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: WARNING keystonemiddleware.auth_token [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:20:39.952226 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561d041189c0 pid: 105504 (default app) Sep 09 06:20:39.954408 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:20:39.955632 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-84398140-def9-40a8-9ea1-f970b33acb92 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001855 Sep 09 06:20:39.955955 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561d041189c0 pid: 105505 (default app) Sep 09 06:20:39.956045 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Fri Sep 9 06:20:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:01.443600 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:01.445700 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002864 Sep 09 06:22:01.446226 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:01.462786 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:01.464108 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell0:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:01.464933 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell1:SELECT=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:01.465987 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:02.365949 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-dcb8f05d-34fe-4cd3-9df2-827bc5555f2f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:02.398411 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-dcb8f05d-34fe-4cd3-9df2-827bc5555f2f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946038 Sep 09 06:22:02.399274 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 9 06:22:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:05.059997 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:05.060943 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6c306347-3d09-446e-a64f-ba91209f527b None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 09 06:22:05.061722 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:05.530097 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-12b22019-0639-4d26-bc53-08cf62345bd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:05.578414 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-12b22019-0639-4d26-bc53-08cf62345bd1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510627 Sep 09 06:22:05.579438 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:05.593296 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_api:SELECT=3 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:05.594149 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_cell0:SELECT=3 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:05.594929 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_cell1:SELECT=3 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:05.595766 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_cell0:SELECT=3 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:05.806450 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-3a017e37-ad49-42b5-85b3-39d07c4fb331 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:05.878553 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-3a017e37-ad49-42b5-85b3-39d07c4fb331 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291020 Sep 09 06:22:05.879136 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 9 06:22:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:08.546919 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-12b22019-0639-4d26-bc53-08cf62345bd1 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:08.548953 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-12b22019-0639-4d26-bc53-08cf62345bd1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002465 Sep 09 06:22:08.549367 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:09.220006 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-5001f276-d880-4649-8730-6a9af9389d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:09.262271 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-5001f276-d880-4649-8730-6a9af9389d66 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706614 Sep 09 06:22:09.263366 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 06:22:09.276263 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-62ea35af-08a3-4a7f-8fd3-a96030f215d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:09.325810 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-62ea35af-08a3-4a7f-8fd3-a96030f215d6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054428 Sep 09 06:22:09.327150 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 9 06:22:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:22:11.938346 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-5001f276-d880-4649-8730-6a9af9389d66 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:11.939535 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-5001f276-d880-4649-8730-6a9af9389d66 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Sep 09 06:22:11.940268 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:12.357931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-fa9c9597-e9b4-4940-a47f-fc1e37dcff31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:12.379029 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-fa9c9597-e9b4-4940-a47f-fc1e37dcff31 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431220 Sep 09 06:22:12.379616 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:12.392645 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-c16466e6-9166-4a64-b0e5-954f9d4e5b25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:12.422127 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-c16466e6-9166-4a64-b0e5-954f9d4e5b25 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033157 Sep 09 06:22:12.423004 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 9 06:22:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:15.065716 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-fa9c9597-e9b4-4940-a47f-fc1e37dcff31 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:15.066724 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-fa9c9597-e9b4-4940-a47f-fc1e37dcff31 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 09 06:22:15.067124 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:15.493874 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-2001aecb-4479-4847-b5d2-d79629012b4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:15.515652 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-2001aecb-4479-4847-b5d2-d79629012b4d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441272 Sep 09 06:22:15.517032 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:15.533337 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-a35bc371-8c5b-43e2-b879-ddb422b00312 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:15.580932 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-a35bc371-8c5b-43e2-b879-ddb422b00312 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052568 Sep 09 06:22:15.582640 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 9 06:22:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:18.355074 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-2001aecb-4479-4847-b5d2-d79629012b4d admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:18.356074 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-2001aecb-4479-4847-b5d2-d79629012b4d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Sep 09 06:22:18.356481 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:18.778900 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:18.800776 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438264 Sep 09 06:22:18.801340 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:18.814014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-2298ce01-048c-4293-a363-6ffa8adf2ec3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:18.841569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-2298ce01-048c-4293-a363-6ffa8adf2ec3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031132 Sep 09 06:22:18.842140 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Fri Sep 9 06:22:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:21.766943 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:21.768138 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Sep 09 06:22:21.768543 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:22:22.190119 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-7a964fe7-20be-44eb-b50e-8f69d3dfb68f admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:22.215819 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-7a964fe7-20be-44eb-b50e-8f69d3dfb68f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440683 Sep 09 06:22:22.216367 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 9 06:22:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:22:24.876794 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:24.877840 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-09867417-36e1-47cd-8f63-c966fd6b79c8 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 09 06:22:24.878271 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:25.360836 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-b77c93a4-48c4-40dc-b97c-29f4e20e270b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:25.386273 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-b77c93a4-48c4-40dc-b97c-29f4e20e270b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.500904 Sep 09 06:22:25.387152 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:25.401919 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-df170a18-0b1e-40f4-9e68-a1d4f7af120c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:25.430236 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-df170a18-0b1e-40f4-9e68-a1d4f7af120c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032510 Sep 09 06:22:25.431927 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 9 06:22:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:22:28.036597 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-b77c93a4-48c4-40dc-b97c-29f4e20e270b admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:28.037645 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-b77c93a4-48c4-40dc-b97c-29f4e20e270b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Sep 09 06:22:28.038251 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:28.440285 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8d6d33c0-7dc7-4822-9a2d-d90f81d8e20c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:28.459001 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8d6d33c0-7dc7-4822-9a2d-d90f81d8e20c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414288 Sep 09 06:22:28.459561 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:28.471926 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-20d7c31c-9712-420f-9169-809a488d7f22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:28.496545 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-20d7c31c-9712-420f-9169-809a488d7f22 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028540 Sep 09 06:22:28.497113 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 9 06:22:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:22:31.140550 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8d6d33c0-7dc7-4822-9a2d-d90f81d8e20c admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:31.141571 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8d6d33c0-7dc7-4822-9a2d-d90f81d8e20c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 09 06:22:31.141975 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:31.565106 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-de1b726f-412b-485d-9061-3c275e75de9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "swap": 0, "disk": 40, "vcpus": 2}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:31.592276 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-de1b726f-412b-485d-9061-3c275e75de9c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.443918 Sep 09 06:22:31.593175 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:31.605506 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-20ae8ff4-3c0e-4766-bdb1-57f40627e7c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:31.610387 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:31.639593 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-20ae8ff4-3c0e-4766-bdb1-57f40627e7c8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037706 Sep 09 06:22:31.640460 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 9 06:22:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:34.302357 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-de1b726f-412b-485d-9061-3c275e75de9c admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:34.303289 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-de1b726f-412b-485d-9061-3c275e75de9c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 09 06:22:34.303981 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:34.764794 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-962b0cb5-c1db-43a8-9ff3-88b93e6a499f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:34.784905 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-962b0cb5-c1db-43a8-9ff3-88b93e6a499f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474148 Sep 09 06:22:34.785451 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:22:34.797715 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-1b64b498-a54f-46e3-9f85-7e5ea197640e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:34.823219 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-1b64b498-a54f-46e3-9f85-7e5ea197640e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029038 Sep 09 06:22:34.824232 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 9 06:22:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:37.460288 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-962b0cb5-c1db-43a8-9ff3-88b93e6a499f admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:37.461314 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-962b0cb5-c1db-43a8-9ff3-88b93e6a499f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 09 06:22:37.461714 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:37.894402 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:37.901637 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:37.917479 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449253 Sep 09 06:22:37.918038 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Fri Sep 9 06:22:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 06:22:37.933432 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-55b23b19-26f0-4c82-ade2-67c84ee10f8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:22:37.960288 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-55b23b19-26f0-4c82-ade2-67c84ee10f8a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033155 Sep 09 06:22:37.960974 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Fri Sep 9 06:22:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:22:57.348809 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:57.349879 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 09 06:22:57.350279 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:57.361749 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:22:57.860703 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-e7002438-a378-40e4-b25c-28424f2f49dc admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:57.878601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-e7002438-a378-40e4-b25c-28424f2f49dc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.521548 Sep 09 06:22:57.879144 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 9 06:22:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:22:59.194944 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:59.196004 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6505acd2-6917-4d94-afba-14448c1c28e3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 09 06:22:59.196397 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:22:59.732339 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-4e89d44f-11c0-48bb-9798-212eff362a5a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:59.737631 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-4e89d44f-11c0-48bb-9798-212eff362a5a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-4e89d44f-11c0-48bb-9798-212eff362a5a admin admin] Request method failure captured: Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept: application/json Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Connection: keep-alive Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Content-Length: 0 Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Host: 10.222.0.25 Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.92 Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABjGtvDLkSzysM41pDjDYKYF0SDUZ1xUNuax4Lzaljhdz4FKonXrPYQ7sikZk5B7o5WvMOl-Fk5y0vjaQKixfQU1iN5J3lvl8DnrAtefa5T_4CNIqE6bDWZ4Da-NjaPhSVJZrcvQvaTl6FWdjl7k36YLuRpM23Nku9jeSSy99xOgEjZcMM Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Role: reader,member,admin Sep 09 06:22:59.741083 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Roles: reader,member,admin Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant: admin Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User: admin Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Name: admin Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: method: > Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: exception: Flavor 42 could not be found. Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: action_args: {'id': '42'} Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:22:59.742623 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:22:59.743601 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.746104 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-4e89d44f-11c0-48bb-9798-212eff362a5a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:22:59.748112 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-4e89d44f-11c0-48bb-9798-212eff362a5a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.406111 Sep 09 06:22:59.748112 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 9 06:22:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 06:22:59.752524 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-4dfc2c42-5bfe-49a3-acec-9802004860cb admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:59.774383 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-4dfc2c42-5bfe-49a3-acec-9802004860cb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025414 Sep 09 06:22:59.775458 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:22:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:22:59.785803 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-3122d544-c689-43c9-bd45-2bbf82155aa6 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:59.808012 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-3122d544-c689-43c9-bd45-2bbf82155aa6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026523 Sep 09 06:22:59.808537 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:22:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:22:59.817721 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-60829b27-c0b4-490a-a2b7-57ad013ee94e admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:22:59.823167 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.wsgi [None req-60829b27-c0b4-490a-a2b7-57ad013ee94e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-60829b27-c0b4-490a-a2b7-57ad013ee94e admin admin] Request method failure captured: Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept: application/json Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept-Encoding: gzip, deflate Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Connection: keep-alive Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Content-Length: 0 Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Host: 10.222.0.25 Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-Api-Version: compute 2.92 Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-System-Scope: None Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: User-Agent: python-novaclient Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Auth-Token: gAAAAABjGtvDLkSzysM41pDjDYKYF0SDUZ1xUNuax4Lzaljhdz4FKonXrPYQ7sikZk5B7o5WvMOl-Fk5y0vjaQKixfQU1iN5J3lvl8DnrAtefa5T_4CNIqE6bDWZ4Da-NjaPhSVJZrcvQvaTl6FWdjl7k36YLuRpM23Nku9jeSSy99xOgEjZcMM Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Id: None Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Name: None Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Identity-Status: Confirmed Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Is-Admin-Project: True Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Id: default Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Name: Default Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Name: admin Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Role: reader,member,admin Sep 09 06:22:59.826497 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Roles: reader,member,admin Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant: admin Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Name: admin Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User: admin Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Id: default Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Name: Default Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Name: admin Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: method: > Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: exception: Flavor 42 could not be found. Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: action_args: {'id': '42'} Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:22:59.828088 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:22:59.829049 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:22:59.830111 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-60829b27-c0b4-490a-a2b7-57ad013ee94e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:22:59.831153 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-60829b27-c0b4-490a-a2b7-57ad013ee94e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013770 Sep 09 06:22:59.831153 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 9 06:22:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:01.054867 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-3122d544-c689-43c9-bd45-2bbf82155aa6 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:01.055926 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-3122d544-c689-43c9-bd45-2bbf82155aa6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 09 06:23:01.057000 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:01.586359 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-126ebc00-2bde-4be7-8bf6-c8e1b6a373b6 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:01.592065 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.wsgi [None req-126ebc00-2bde-4be7-8bf6-c8e1b6a373b6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-126ebc00-2bde-4be7-8bf6-c8e1b6a373b6 admin admin] Request method failure captured: Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept: application/json Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept-Encoding: gzip, deflate Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Connection: keep-alive Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Content-Length: 0 Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Host: 10.222.0.25 Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-Api-Version: compute 2.92 Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-System-Scope: None Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: User-Agent: python-novaclient Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Auth-Token: gAAAAABjGtvE20oyaCbZeOuqAqkWqEFSIzcHS2tzeGJP9OsGz2Pa655revCeIBnherSDxkEJoIR3RU-tF5NxTMTEO2UtDqJWeqnzBmPsBTWMTxVjbOh2F0KH4hOz4q4ftYJBtKcVOYBMkHAK_d8OTuDFqxQLbmINAmEyxbMiNylIMb1EHmOGEKQ Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Id: None Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Name: None Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Identity-Status: Confirmed Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Is-Admin-Project: True Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Id: default Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Name: Default Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Name: admin Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Role: reader,member,admin Sep 09 06:23:01.593569 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Roles: reader,member,admin Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant: admin Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Name: admin Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User: admin Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Id: default Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Name: Default Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Name: admin Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: method: > Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: exception: Flavor 84 could not be found. Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: action_args: {'id': '84'} Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:23:01.595462 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:01.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.598014 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-126ebc00-2bde-4be7-8bf6-c8e1b6a373b6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:23:01.599314 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-126ebc00-2bde-4be7-8bf6-c8e1b6a373b6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.400770 Sep 09 06:23:01.599314 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 9 06:23:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:01.605311 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-15e46f0e-0bb7-4005-ab18-1a008bc34a5d admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:01.620442 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-15e46f0e-0bb7-4005-ab18-1a008bc34a5d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018914 Sep 09 06:23:01.620972 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:23:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:23:01.630252 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-25213919-43ae-4635-a731-61d7e997da06 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:01.646242 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-25213919-43ae-4635-a731-61d7e997da06 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019433 Sep 09 06:23:01.646782 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:23:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:23:01.656714 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-483696b3-c343-49e0-b320-08b25207863a admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:01.661654 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-483696b3-c343-49e0-b320-08b25207863a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-483696b3-c343-49e0-b320-08b25207863a admin admin] Request method failure captured: Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept: application/json Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Connection: keep-alive Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Content-Length: 0 Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Host: 10.222.0.25 Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.92 Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABjGtvE20oyaCbZeOuqAqkWqEFSIzcHS2tzeGJP9OsGz2Pa655revCeIBnherSDxkEJoIR3RU-tF5NxTMTEO2UtDqJWeqnzBmPsBTWMTxVjbOh2F0KH4hOz4q4ftYJBtKcVOYBMkHAK_d8OTuDFqxQLbmINAmEyxbMiNylIMb1EHmOGEKQ Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Role: reader,member,admin Sep 09 06:23:01.663153 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Roles: reader,member,admin Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant: admin Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User: admin Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Name: admin Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: method: > Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: exception: Flavor 84 could not be found. Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: action_args: {'id': '84'} Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:23:01.664805 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:01.666443 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:01.667931 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-483696b3-c343-49e0-b320-08b25207863a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:23:01.669207 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-483696b3-c343-49e0-b320-08b25207863a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011330 Sep 09 06:23:01.669207 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Sep 9 06:23:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:02.873478 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-25213919-43ae-4635-a731-61d7e997da06 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:02.874483 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-25213919-43ae-4635-a731-61d7e997da06 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 09 06:23:02.874871 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:03.397352 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-159704a7-391b-44e1-8cbd-7fcab6ebfbef admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:03.404460 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.wsgi [None req-159704a7-391b-44e1-8cbd-7fcab6ebfbef admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-159704a7-391b-44e1-8cbd-7fcab6ebfbef admin admin] Request method failure captured: Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept: application/json Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Accept-Encoding: gzip, deflate Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Connection: keep-alive Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Content-Length: 0 Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Host: 10.222.0.25 Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-Api-Version: compute 2.92 Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Openstack-System-Scope: None Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: User-Agent: python-novaclient Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Auth-Token: gAAAAABjGtvGo8Mf6G78HY2yt6IvyM8-eyhx9KRwda978wA1ioqEO3Oyfkfr1mJCsE4g7EmKX8r03Hy2G-ch-uHW8g9Nym6Pyc-vYmPEsEqiubLAqJpJ7ciKLbsgQNN2zLzfqkuOjBW-whkJtrsOyzu0JNpJHsB8pi9Y3b500Om3Cu0OiKvYpLE Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Id: None Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Domain-Name: None Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Identity-Status: Confirmed Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Is-Admin-Project: True Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Id: default Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Domain-Name: Default Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Project-Name: admin Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Role: reader,member,admin Sep 09 06:23:03.405993 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Roles: reader,member,admin Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant: admin Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-Tenant-Name: admin Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User: admin Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Id: default Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Domain-Name: Default Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: X-User-Name: admin Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: method: > Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: exception: Flavor 451 could not be found. Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: action_args: {'id': '451'} Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:23:03.407375 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:03.408402 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.409479 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-159704a7-391b-44e1-8cbd-7fcab6ebfbef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:23:03.410537 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-159704a7-391b-44e1-8cbd-7fcab6ebfbef admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395284 Sep 09 06:23:03.410537 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:23:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 06:23:03.418064 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6b0224eb-2fa2-411e-9334-c974a1bc867b admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:03.433553 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6b0224eb-2fa2-411e-9334-c974a1bc867b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019893 Sep 09 06:23:03.434105 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:23:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:23:03.444017 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:03.458940 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018630 Sep 09 06:23:03.459487 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Sep 9 06:23:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:23:03.469531 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6e2a7f02-2769-47cd-abed-7f51492cfe3c admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:03.474760 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.wsgi [None req-6e2a7f02-2769-47cd-abed-7f51492cfe3c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6e2a7f02-2769-47cd-abed-7f51492cfe3c admin admin] Request method failure captured: Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept: application/json Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Accept-Encoding: gzip, deflate Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Connection: keep-alive Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Content-Length: 0 Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Host: 10.222.0.25 Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-Api-Version: compute 2.92 Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Openstack-System-Scope: None Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: User-Agent: python-novaclient Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Auth-Token: gAAAAABjGtvGo8Mf6G78HY2yt6IvyM8-eyhx9KRwda978wA1ioqEO3Oyfkfr1mJCsE4g7EmKX8r03Hy2G-ch-uHW8g9Nym6Pyc-vYmPEsEqiubLAqJpJ7ciKLbsgQNN2zLzfqkuOjBW-whkJtrsOyzu0JNpJHsB8pi9Y3b500Om3Cu0OiKvYpLE Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Id: None Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Domain-Name: None Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Identity-Status: Confirmed Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Is-Admin-Project: True Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Id: default Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Domain-Name: Default Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Project-Name: admin Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Role: reader,member,admin Sep 09 06:23:03.476302 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Roles: reader,member,admin Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/df82cd1e5393473c92978bf22c792e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant: admin Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Id: df82cd1e5393473c92978bf22c792e3e Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-Tenant-Name: admin Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User: admin Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Id: default Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Domain-Name: Default Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Id: 285daab328104f75886dde4ae3928fec Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: X-User-Name: admin Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: method: > Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: exception: Flavor 451 could not be found. Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: action_args: {'id': '451'} Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:23:03.477965 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:03.480096 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: ERROR nova.api.openstack.wsgi Sep 09 06:23:03.481484 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-6e2a7f02-2769-47cd-abed-7f51492cfe3c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:23:03.482758 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-6e2a7f02-2769-47cd-abed-7f51492cfe3c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011712 Sep 09 06:23:03.482758 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:23:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 06:23:04.696910 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:04.698021 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 09 06:23:04.698412 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:05.226154 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-e76c4265-7c7e-44de-ab7d-4fab9462f507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:23:05.245355 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-e76c4265-7c7e-44de-ab7d-4fab9462f507 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.410196 Sep 09 06:23:05.245897 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 9 06:23:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 06:23:06.471115 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:06.472166 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Sep 09 06:23:06.472566 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:07.007319 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-dd6d7653-1521-423f-938b-067630e07b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:23:07.024759 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-dd6d7653-1521-423f-938b-067630e07b3f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.413166 Sep 09 06:23:07.026054 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 9 06:23:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:23:08.247593 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:08.248606 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 09 06:23:08.249003 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:08.769004 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-5c51f276-d2e8-472e-bef8-b73e46954182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:23:08.788100 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-5c51f276-d2e8-472e-bef8-b73e46954182 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399842 Sep 09 06:23:08.788640 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 9 06:23:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:23:10.015415 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:10.016456 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 09 06:23:10.016847 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:10.535164 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-370d7677-0edd-42bc-8e2e-bc793e506a7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:23:10.555588 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-370d7677-0edd-42bc-8e2e-bc793e506a7f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.399725 Sep 09 06:23:10.556143 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Sep 9 06:23:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:23:11.774042 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:11.775076 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 09 06:23:11.776117 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:23:12.293780 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-e3b27557-ca4b-439f-b861-8225e02f632d admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:23:12.314474 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-e3b27557-ca4b-439f-b861-8225e02f632d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400403 Sep 09 06:23:12.315009 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Sep 9 06:23:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:24:08.978481 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:08.979890 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-6ca36539-b411-4595-8d1b-1742c1650961 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Sep 09 06:24:08.980290 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Fri Sep 9 06:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:24:08.990696 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:09.368414 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-60636282-057d-4e96-a0cb-71eeefe07a9d admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:09.390214 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-60636282-057d-4e96-a0cb-71eeefe07a9d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403893 Sep 09 06:24:09.390751 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Fri Sep 9 06:24:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:24:09.411327 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=14 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:24:09.415205 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-812558a9-466f-4e42-8161-d5a75f8b268e admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:09.422992 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-812558a9-466f-4e42-8161-d5a75f8b268e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013032 Sep 09 06:24:09.423779 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Sep 9 06:24:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:24:09.435584 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-83d5bd43-bda2-4949-a3c9-28e90666d05b admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:09.442779 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-83d5bd43-bda2-4949-a3c9-28e90666d05b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011321 Sep 09 06:24:09.443292 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Sep 9 06:24:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:24:09.455497 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:09.462545 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010476 Sep 09 06:24:09.463156 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Fri Sep 9 06:24:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:24:09.474812 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-5dd1aca7-bae7-4950-9e4a-a66b7b3ada46 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:24:09.482237 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-5dd1aca7-bae7-4950-9e4a-a66b7b3ada46 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011339 Sep 09 06:24:09.482746 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Fri Sep 9 06:24:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:27:08.405255 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:08.406273 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 09 06:27:08.406661 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:27:08.548963 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_api:SELECT=6 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:08.708435 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:08.713749 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:08.714222 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:08.714650 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:08.715363 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:08.715833 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:08.716250 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:08.750439 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-8d95713b-464b-4673-8d7e-3b41ab2164fd admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.202591 Sep 09 06:27:08.751068 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:27:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:27:09.846788 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:09.847847 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 09 06:27:09.848238 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:27:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:27:10.038925 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:10.042972 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:10.043449 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:10.043907 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:10.044630 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:10.045084 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:10.045508 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:10.064666 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-216da163-bffd-4f7a-a9f8-0c4e86b0ffb5 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076003 Sep 09 06:27:10.065214 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:27:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:27:21.544034 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:21.545180 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Sep 09 06:27:21.545662 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:27:21.690277 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_cell0:SELECT=4 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:21.691023 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_cell1:SELECT=4 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:21.691648 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG dbcounter [-] [105505] Writing DB stats nova_api:SELECT=8 {{(pid=105505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:27:21.740094 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:21.743529 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:21.744027 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:21.744460 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:21.745234 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:21.745687 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:21.746106 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:21.771073 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-5979f84b-e851-4a65-bc17-21e3bab56ef3 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085187 Sep 09 06:27:21.771646 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:27:21 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:27:22.849300 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG nova.api.openstack.wsgi [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] Calling method '>' {{(pid=105504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:22.850323 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: INFO nova.api.openstack.requestlog [None req-8981236f-0d1f-4e41-b208-a07d43a1d432 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 09 06:27:22.850716 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: [pid: 105504|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Sep 9 06:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:27:23.045642 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG nova.api.openstack.wsgi [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Calling method '>' {{(pid=105505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:27:23.049045 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:23.049521 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:23.050107 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:23.050827 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:27:23.051279 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:27:23.051793 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: DEBUG oslo_concurrency.lockutils [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:27:23.073241 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: INFO nova.api.openstack.requestlog [None req-1e64d896-eab2-4a54-b9f3-2d34eb608842 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.079209 Sep 09 06:27:23.073889 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: [pid: 105505|app: 0|req: 38/76] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Sep 9 06:27:22 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:28:22.666229 dv-cinder-852209-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 06:28:22.666849 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: Fri Sep 9 06:28:22 2022 - graceful shutdown triggered... Sep 09 06:28:22.667306 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: Gracefully killing worker 1 (pid: 105504)... Sep 09 06:28:22.667773 dv-cinder-852209-16-iscsi devstack@n-api.service[105505]: Gracefully killing worker 2 (pid: 105505)... Sep 09 06:28:22.793619 dv-cinder-852209-16-iscsi devstack@n-api.service[105504]: DEBUG dbcounter [-] [105504] Writing DB stats nova_api:SELECT=4 {{(pid=105504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:28:23.667304 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: worker 1 buried after 1 seconds Sep 09 06:28:23.667794 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: worker 2 buried after 1 seconds Sep 09 06:28:23.667794 dv-cinder-852209-16-iscsi devstack@n-api.service[105503]: goodbye to uWSGI. Sep 09 06:28:23.668878 dv-cinder-852209-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 06:28:23.669426 dv-cinder-852209-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 06:28:23.672259 dv-cinder-852209-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 06:28:23.681556 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 06:28:23.684186 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 06:28:23 2022] *** Sep 09 06:28:23.684348 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 06:28:23.684483 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 06:28:23.684606 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: nodename: dv-cinder-852209-16-iscsi Sep 09 06:28:23.684719 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: machine: x86_64 Sep 09 06:28:23.684836 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: clock source: unix Sep 09 06:28:23.684949 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: pcre jit disabled Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: detected number of CPU cores: 4 Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: current working directory: / Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: detected binary path: /usr/bin/uwsgi-core Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: your processes number limit is 47680 Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: your memory page size is 4096 bytes Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: detected max file descriptor number: 2048 Sep 09 06:28:23.685075 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: lock engine: pthread robust mutexes Sep 09 06:28:23.685574 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: thunder lock: enabled Sep 09 06:28:23.685574 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 06:28:23.685574 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 06:28:23.727896 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: Python main interpreter initialized at 0x558a80b779c0 Sep 09 06:28:23.727896 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: python threads support enabled Sep 09 06:28:23.727896 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: your server socket listen backlog is limited to 100 connections Sep 09 06:28:23.727896 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: your mercy for graceful operations on workers is 90 seconds Sep 09 06:28:23.728344 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 06:28:23.728344 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: *** Operational MODE: preforking *** Sep 09 06:28:23.728624 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: *** uWSGI is running in multiple interpreter mode *** Sep 09 06:28:23.728624 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: spawned uWSGI master process (pid: 120778) Sep 09 06:28:23.728833 dv-cinder-852209-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 06:28:23.731582 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: spawned uWSGI worker 1 (pid: 120795, cores: 1) Sep 09 06:28:23.731582 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: spawned uWSGI worker 2 (pid: 120797, cores: 1) Sep 09 06:28:23.731582 dv-cinder-852209-16-iscsi devstack@n-api.service[120778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 06:28:24.400860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 06:28:24.408301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 06:28:25.574888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:28:25.574888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: from cryptography.utils import int_from_bytes Sep 09 06:28:25.575475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:28:25.575475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: from cryptography.utils import int_from_bytes Sep 09 06:28:25.597895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:28:25.597895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: from cryptography.utils import int_from_bytes Sep 09 06:28:25.598493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 06:28:25.598493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: from cryptography.utils import int_from_bytes Sep 09 06:28:28.011357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:28:28.011941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:28:28.012097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:28:28.012664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:28:28.012931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:28:28.013333 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.013662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.013990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.014314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.014651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.014972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.015293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.015643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.015977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.016242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.016561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.017063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-16-iscsi {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.017391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.017723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.018031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.018350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.018658 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.018983 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.019304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.019857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.021947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.022171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.022476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.022804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.023703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.024228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-16-iscsi {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.024561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.024873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.025200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.025615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.025931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.026245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.026563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.026909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.027214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.027620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.027899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.028219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.028553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.028850 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.029164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.029474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.029799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.030153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.030415 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.030668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.030980 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.031304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.031649 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.031975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.032228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.032481 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.032801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.033124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.033433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.033741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.034048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.034359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.034670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.034977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.035294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.035611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.035936 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.036255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.036579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.036890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.037209 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.037625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.037880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.038191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.038536 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.039478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.039827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.040148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.040476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.040791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.041102 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.041411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.041734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.042073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.042381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.042636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.042940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.043246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.043590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.043904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.044211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.044517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.044820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.045130 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.045436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.045745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.046051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.046358 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.046665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.046972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.047281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.047606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.047916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.048245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.048564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.048874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.049182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.049489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.049799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.050119 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.050428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.050737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.051060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.051369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.051699 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.052020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.052329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.053944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.053944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.053944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.053944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.053944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.054396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.054478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.054791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.055097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.055405 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.055737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.056043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.056348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.056651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.056976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.057298 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.057614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.057923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.058229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.058552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.058893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.059231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.059614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.059922 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.060255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.060588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.060918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.061235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.061552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.061882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.062196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.062511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.062826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.063148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.063470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.063832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.064150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.064470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.064793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.065119 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.065428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.065755 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.066083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.066397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.067244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.067244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.067403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.067737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.068067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.068383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.068697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.069105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.069345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.069662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.070043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.070367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.070687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.071025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.071340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.071678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.071997 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.074554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.075147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.075147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.075502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.075716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.076030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.076336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.076649 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.076957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.077285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.077619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.077926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.078270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.078580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.078894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.079206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.079519 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.079857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.080178 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.080517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.080850 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.081249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.083776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.084071 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.084383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.084712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.085030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.085340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.086277 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.086617 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.086931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.087260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.087611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.087942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.088246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.088558 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.088866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.089174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.089479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.089789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.090096 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.090213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 06:28:28.090634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.090732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 06:28:28.090827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.090991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.091093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 06:28:28.091300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.091403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 06:28:28.091621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 06:28:28.091733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.091948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.092044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.092258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.092365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.092566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.092668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.092874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.092969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.093223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.093320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.093533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.093637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.093853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.093964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.094173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.094301 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.094497 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.094616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.094758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.094915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.095057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.095190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.095431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.095605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-16-iscsi {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.095771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.095920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.096087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.096215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.096402 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.096547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.096717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.096861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.097041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.097185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.097356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.097492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.097677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.097821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.097989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.098205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.098379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.098514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.098652 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.098785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.098916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.099095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.099239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.099431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.099598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.099768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.099904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.100076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.100223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.100395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.100532 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.100701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.100837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.101104 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.102090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.102265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.102859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.103186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-16-iscsi {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.103340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.103500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.103734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.103896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.104054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.104210 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.104472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.104645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.104796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.104951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.105107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.105287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.105950 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.106121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.107505 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.107705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.107852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.107987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.108135 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.108270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.108401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.108532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.108672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.108812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.108957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.109090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.109221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.109360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.109492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.109623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.109762 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.109895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.110026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.110157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.110157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.110422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.110568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.110697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.110829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.110968 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.111100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.111244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.111388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.111520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.111691 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.111825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.111965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.112112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.112252 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.112386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.112507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.112646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.112779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.112919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.113185 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113185 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113185 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113185 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.113821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.113959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.114091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.114230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.114376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.114619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.114763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.114896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.115027 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.115159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.115304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.115436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.115590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.115737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.115867 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.115980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.116106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.116240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.116386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.116526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.116666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.117330 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.117468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.117468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.117727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.117867 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.117998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.118141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.118274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.118406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.118537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.118667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.118837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.118983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.119151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.119294 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.119471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.119637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.119810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.119963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.120124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.120268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.120448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.120584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.120782 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.120917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.121048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.121179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.121366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.121503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.121682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.121826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.121997 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.122140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.122302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.122445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.122591 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.122724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.122905 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.123041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.123223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.123366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.123514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.123728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.123863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.124002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.124143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.124290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.124423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.124553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.124711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.124998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.125141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.125304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.125448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.125608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.125752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.125912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.126056 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.126218 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.126354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.126519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.126667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.126809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.126940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.127108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.127244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.127409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.127571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.127751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.127945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.128080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.128261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.128357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.128570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.128685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.128883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.129002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.129189 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.129303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.129494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.129586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.129801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.129904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.130106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.130224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.130417 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.130509 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.130720 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.130823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.131037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.131133 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.131326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.131430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.131667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.131760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.131962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.132066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.132267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.132391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.133185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.133367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.133597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.133697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.134053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.134145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.134365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.134458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.134671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.134785 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.134977 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.135077 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.135282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.135374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.135623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.135736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.135930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.136032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.136233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.136324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.136542 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.136711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.136850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.136993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.137134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.137275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.137447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.137581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.137754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.137901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.138048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.138188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.138327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.138464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.138648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 06:28:28.138792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.138983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139784 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.139959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.140900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.141947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142560 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.142863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143349 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.143975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.144958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145239 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.145933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.146857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147181 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.147962 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.148205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.148353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.148558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.148777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.148912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149053 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149548 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.149998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150782 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.150922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.151889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152044 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152486 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.152958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153107 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153731 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.153897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154812 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.154976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155111 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155248 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155742 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.155892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156787 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.156959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157429 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.157923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158055 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.158985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159146 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159609 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.159938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160550 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.160872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.161971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.162894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163205 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163339 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.163882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164306 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.164957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.165940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166081 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.166867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.167959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168563 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.168870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169013 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169477 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.169915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170081 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.170829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171001 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171146 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171308 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.171995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.172920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173384 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.173850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174323 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174775 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.174954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175609 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.175932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176075 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.176877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177021 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.177831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.178898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.179093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.179765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.180004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.180204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.180573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.180709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.180934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181067 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.181878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.182986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183155 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.183969 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184460 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.184934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.185877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.186969 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.187104 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.187277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.187434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188452 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.188953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.189904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.190999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191280 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191420 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.191880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192025 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192570 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.192988 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193390 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193817 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.193950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194371 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.194845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.195604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.195929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.196921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197099 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.197875 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.198972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.199912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200353 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200836 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.200980 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201449 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201755 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.201891 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202061 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.202989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.203125 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.203315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.203584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.203725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.203926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204249 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204358 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204881 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.204981 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.205948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.206866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207789 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.207971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.208903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209509 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.209955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.210953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.211137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.211424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.212996 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.213971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214802 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.214935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.215959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.216990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217401 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.217963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218777 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.218910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219324 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.219909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.220965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.221993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222444 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.222906 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223511 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.223997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224591 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.224916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225225 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.225947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.226127 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.226280 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.226477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.226623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227611 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.227942 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228086 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.228863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.229931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230099 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230682 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.230965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231099 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231418 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.231903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.232936 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233102 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233238 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.233829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234760 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.234982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235294 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.235917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.236975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237151 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.237885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.238987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239775 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.239948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.240967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.241143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.241290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.241453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.241589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.242294 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.242437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.242618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.242832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.242968 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.243986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.244931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245695 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.245859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246458 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246599 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.246904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247385 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.247857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.248845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.249940 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.250872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251691 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.251856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252484 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.252940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253215 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253390 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.253858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254156 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.254854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.255852 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.256842 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257009 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257150 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.257888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.258922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.259866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260602 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.260918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261696 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.261974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262266 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262766 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.262914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.263880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.264943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265852 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.265987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266460 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266764 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.266900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.267853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.268951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.269882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270327 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270828 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.270981 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.271922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272102 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.272856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.273594 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.273740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.273998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.274168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.274386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.274583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.274744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.274909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275565 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.275878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.276942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277109 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277416 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277560 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.277853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.278858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279523 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.279970 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.280921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.281061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:28:28.281201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.281396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.281705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.282026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.282343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.282658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.282972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.283285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.283621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.283939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.284261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.284573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.284888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.285202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.285519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.286049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.286386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.286705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.287022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.287339 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.287678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.287996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.288311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.289312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.289756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.290074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.290405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.290728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.291056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.291394 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.291740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.292060 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.292377 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.292693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.293048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.293365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.293674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.293990 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.294305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.294619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.294937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.295247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.295596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.295897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.296208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.296518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.296853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.297139 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.297462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.297797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.298117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.298431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.298746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.299062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.299605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.299922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.300255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.300581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.300904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.301223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.301544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.301872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.302179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.302485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.302796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.303103 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.303406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.303751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.304065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.304421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.305007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.305334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.305871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.306221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.306539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.306866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.307193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.307512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.307845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.308170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.308476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.308782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.309103 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.309414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.309719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.310024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.310335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.310642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.310946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.311256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.311576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.311908 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.312215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.312518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.312822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.313132 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.313436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.313739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.314045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.314349 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.314663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.314972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.315361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.315700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.316014 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.316367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.316680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.316987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.317310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.317616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.317922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.318240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.318550 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.318874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.319186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.319495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.320375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.320932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.321510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.321849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.322174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.322602 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.322944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.323256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.323584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.323900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.324228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.324542 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.324863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.325176 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.325487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.325800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.326110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.326420 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.326730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.327041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.327352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.327686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.327997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.328308 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.328615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.328928 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.329268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.329587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.329948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.330216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.330531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.330840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.331149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.331458 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.331795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.332113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.332441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.332758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.333063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.333481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.333795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.334114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.334437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.334752 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.335075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.335397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.336383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.336719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.337032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.337366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.337710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.338040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.338367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.338677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.338983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.339290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.339623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.339949 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.340262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.340568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.340873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.341183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.341488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.341792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.342095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.342399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.342706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.343007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.343310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.343490 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO dbcounter [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Registered counter for database nova_api Sep 09 06:28:28.343673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.343927 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.344230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.344531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.344844 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.345145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.345449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.345752 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.346053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.346354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.346685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.347019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.347332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.347684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.347998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.348321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.348632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.348954 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.349275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.349592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.349905 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.350261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.350548 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.350862 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.351197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.352117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.352447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.352766 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.353100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.353430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.353738 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.354066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.354387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.354716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.355032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.355344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.355698 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.356012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.356323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.356633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.356944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.357253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.357568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.357875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.358183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.358498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.359059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.359202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.359592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.359781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.360106 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.360435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.360786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.361100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.361445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.361776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.362086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.362405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.362710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 06:28:28.362958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120797) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 06:28:28.364186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.370854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writer thread running {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.426362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO dbcounter [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Registered counter for database nova_api Sep 09 06:28:28.427891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.context [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c899fb98-16f2-46e4-8e27-e32c68678e5e(cell1) {{(pid=120795) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 06:28:28.432379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:28:28.432858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:28:28.434391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:28:28.435150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:28:28.435622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:28:28.437601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:28:28.439646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO dbcounter [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Registered counter for database nova_cell0 Sep 09 06:28:28.443679 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO dbcounter [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Registered counter for database nova_cell1 Sep 09 06:28:28.447211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_db.sqlalchemy.engines [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.451511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.453633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.454000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writer thread running {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.462160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writer thread running {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.462495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writer thread running {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.513347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.context [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c899fb98-16f2-46e4-8e27-e32c68678e5e(cell1) {{(pid=120797) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 06:28:28.517334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:28:28.517824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:28:28.519396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:28:28.520175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:28:28.520630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:28:28.522627 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:28:28.525703 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO dbcounter [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Registered counter for database nova_cell0 Sep 09 06:28:28.529748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO dbcounter [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Registered counter for database nova_cell1 Sep 09 06:28:28.536668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_db.sqlalchemy.engines [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.539592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_db.sqlalchemy.engines [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.543907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writer thread running {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.611136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO dbcounter [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Registered counter for database nova_cell0 Sep 09 06:28:28.617949 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.623010 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writer thread running {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.694569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writer thread running {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.705094 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO dbcounter [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Registered counter for database nova_cell0 Sep 09 06:28:28.712591 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_db.sqlalchemy.engines [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120797) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 06:28:28.717214 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writer thread running {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 06:28:28.949440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: WARNING keystonemiddleware.auth_token [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:28:28.957009 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: WARNING keystonemiddleware.auth_token [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:28:29.056564 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: WARNING keystonemiddleware.auth_token [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:28:29.064572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: WARNING keystonemiddleware.auth_token [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:28:29.311331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: WARNING keystonemiddleware.auth_token [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:28:29.317651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: WARNING keystonemiddleware.auth_token [None req-b6d51e9d-1b17-4107-b7a1-2e5fa3af192a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:28:29.323479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a80b779c0 pid: 120795 (default app) Sep 09 06:28:29.418091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: WARNING keystonemiddleware.auth_token [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 06:28:29.424516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: WARNING keystonemiddleware.auth_token [None req-10491cee-d0a0-455b-a3d0-0f59622a20a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 06:28:29.430668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558a80b779c0 pid: 120797 (default app) Sep 09 06:29:20.600512 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:20.606210 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:20.609151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:20.617136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:21.989874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1286811869", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:22.761461 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] validate_networks() for [('98282524-73a1-460b-a31c-3ff4ef655afa', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:23.371144 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:23.372134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:23.372973 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:23.373701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:24.657387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-998118421", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "networks": [{"uuid": "30943901-e8e0-46eb-9df1-160e7b261a53"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:24.724276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:24.724838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:24.725452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:24.726187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:24.726735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:24.778595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:24.779853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:24.781308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:24.783067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:24.785187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:24.786270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:24.873432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:24.882339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for user 3e2bdc73390a43ff9eccc57948e2b4a6 and project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:24.921974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:24.931700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:25.125161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-adbac16e-c722-4e93-a65e-98a60869a9b2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.548816 Sep 09 06:29:25.125826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:29:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:29:25.444913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] validate_networks() for [('30943901-e8e0-46eb-9df1-160e7b261a53', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:25.757286 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cb250496-0909-4793-97fe-9188f77f2d41 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: .version_select at 0x7f74ad5be310>, body: {"keypair": {"name": "tempest-keypair-1338580225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkFaSnYr9ZK5IxVhSk3F6Jrt0+hrx87zW56JFZ7kbFXu2/ueBNW97mT+NLw73W7waMajJkxHWgtBOOBXmWlxnSK0E5az9Jv7VyXIJSHzF9BR3okccjJwwMpO0aEkDr30w=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:25.837428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-cb250496-0909-4793-97fe-9188f77f2d41 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for project 7a732015d4244c378e0204e1d216f57b. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:25.849304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-cb250496-0909-4793-97fe-9188f77f2d41 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for user 1c86ccfec70340c797ecba83163ff1a2 and project 7a732015d4244c378e0204e1d216f57b. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:25.946096 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cb250496-0909-4793-97fe-9188f77f2d41 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.815859 Sep 09 06:29:25.948321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 2/2] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:29:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:25.976335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f83a11f7-8058-4f7a-aa81-f6fa89783782 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:25.976959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f83a11f7-8058-4f7a-aa81-f6fa89783782 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:26.428672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f83a11f7-8058-4f7a-aa81-f6fa89783782 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:26.461967 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f83a11f7-8058-4f7a-aa81-f6fa89783782 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1222 microversion: 2.1 time: 0.511989 Sep 09 06:29:26.466709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 3/3] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:25 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1222 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:26.710814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-131237496", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:26.857925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] validate_networks() for [('98282524-73a1-460b-a31c-3ff4ef655afa', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:27.760368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:27.761419 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:27.762226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:27.762836 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:27.763489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:27.798558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:27.799292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:27.801220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:27.802323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:27.803005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:27.803707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:27.881350 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Getting quotas for project 584cd5d9848d48dea5ac9a01dbaaabf1. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:27.892075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Getting quotas for user 5f4d9c2505f744b4b62fffac21648f0b and project 584cd5d9848d48dea5ac9a01dbaaabf1. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:27.935880 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:27.938872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:28.214666 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7e26fdfe-970a-492b-9228-f13e881f244d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.848562 Sep 09 06:29:28.239737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 1/4] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:29:28.674841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:28.675336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:28.675889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:28.676426 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:28.677153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:28.695407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:28.705916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:28.706508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:28.722991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:28.724211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:28.726311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:28.782746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-37955795-d5ae-4752-b5e5-f59818004fc7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: .version_select at 0x7f74ad5c1310>, body: {"keypair": {"name": "tempest-keypair-969809216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxR1eii8uymbV1fsuWiEF98XQU3hMZcIkqWfPOkoPN2T5a9QLvJrGhTuf1ozTnu//W2U20mSAaiZ5RP9oP8xrgWn9P4qqlmcOF+4bRr3O/efAQkLZ9YuJlLdYosmwicLQ=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:28.798701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:28.813882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for user 3e2bdc73390a43ff9eccc57948e2b4a6 and project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:28.865987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-37955795-d5ae-4752-b5e5-f59818004fc7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:28.866705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:28.875283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:28.888640 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-37955795-d5ae-4752-b5e5-f59818004fc7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for user 0a6757e5408e40cc85ad6145064d8ba7 and project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:28.996980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-37955795-d5ae-4752-b5e5-f59818004fc7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.748669 Sep 09 06:29:28.997957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 2/5] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 9 06:29:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 758 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 06:29:29.017547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-09c936cd-4122-4791-8c7b-1cdba77ef996 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:29.023328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1fb09a6b-491d-41ea-b952-a2cd5c14504f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.319792 Sep 09 06:29:29.026607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 4/6] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:29:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 06:29:29.035441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-09c936cd-4122-4791-8c7b-1cdba77ef996 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:29.050620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-94ef1816-10d9-4afd-9296-f64d2000bf40 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:29.052144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-94ef1816-10d9-4afd-9296-f64d2000bf40 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:29.229635 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-94ef1816-10d9-4afd-9296-f64d2000bf40 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:29.238846 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-94ef1816-10d9-4afd-9296-f64d2000bf40 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1221 microversion: 2.1 time: 0.203835 Sep 09 06:29:29.246366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:29 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:29.378597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-09c936cd-4122-4791-8c7b-1cdba77ef996 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:29.409357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-09c936cd-4122-4791-8c7b-1cdba77ef996 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1214 microversion: 2.1 time: 0.407846 Sep 09 06:29:29.412822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:29 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:30.066999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-49ae87e8-aa5e-4cd5-aa80-762130011bdf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: .version_select at 0x7f74ad570dc0>, body: {"keypair": {"name": "tempest-keypair-1088411147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3uJDWcMnO89/WZodtI/ST6RJcUa8ycR7UaYWsF49FOEayQY2TjITNa0YFBLeA6VETFHnayWJhJQJse0DhOOxPKgDQJ7z1FKNUfvOgaQbmedqi7vjvz5KZ0qO0hCffv8Q=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:30.130851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-49ae87e8-aa5e-4cd5-aa80-762130011bdf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:30.152561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-49ae87e8-aa5e-4cd5-aa80-762130011bdf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:30.249711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-49ae87e8-aa5e-4cd5-aa80-762130011bdf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.978428 Sep 09 06:29:30.255462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 6/9] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:29:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:30.284101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:30.286461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:30.332487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:30.333384 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:30.343864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:30.344727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:30.345230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:30.352605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:30.434422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:30.435834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:30.445689 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:30.446529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:30.452993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:30.458095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:30.460463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:30.461840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:31.320283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:31.333724 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:31.358934 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e2e1ce11-440c-433d-b49d-3dc7da370615 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1217 microversion: 2.1 time: 1.086273 Sep 09 06:29:31.362280 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-216b3474-d42c-459a-a854-3dd4d8c337a8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1218 microversion: 2.1 time: 0.925562 Sep 09 06:29:31.365087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 4/11] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:30 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1217 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:31.383276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:30 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1218 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:29:32.392007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:32.392764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:32.393215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:32.394067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:32.403690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:32.405063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:32.407772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:32.408491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:32.410567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:32.411335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:32.411867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:32.412625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:32.413111 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:32.413551 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:32.414702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:32.416034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:32.903176 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:32.915038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b3457bd7-9632-4370-9b79-5f72bf32ac87 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1279 microversion: 2.1 time: 0.527035 Sep 09 06:29:32.918415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:32 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1279 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:32.933127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:32.956546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c16bb265-8387-490a-b6e3-a84015ddc8b0 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1266 microversion: 2.1 time: 0.569886 Sep 09 06:29:32.957221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:32 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1266 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:29:33.944007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:33.945393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:33.962963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:33.972269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:33.976745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:33.981392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:33.989112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:33.995194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:33.999373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:34.001298 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:34.025164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:34.026388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:34.028670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:34.034641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:34.036041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:34.045336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:34.882629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:34.883305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:34.891851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8d1f0865-bbe2-474e-bb1a-c38734d97507 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1272 microversion: 2.1 time: 0.910303 Sep 09 06:29:34.892434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 9/14] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:33 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1272 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:34.901531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2941cfb1-0deb-4f39-81ab-8fdbc5f15c2a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1279 microversion: 2.1 time: 0.961757 Sep 09 06:29:34.920400 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 6/15] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:33 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1279 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:35.683363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1231862743", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06aa4853-deab-4da2-aa65-5023553defd4"}], "security_groups": [{"name": "tempest-securitygroup--914135027"}], "key_name": "tempest-keypair-969809216", "user_data": "}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:35.919474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:35.920365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:35.937959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:35.943709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:35.945051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:35.949287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:35.950727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:35.952821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:37.111504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:37.149796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-997507fb-c6f9-4c1b-b5f7-ffc9c5db3655 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1272 microversion: 2.1 time: 1.233605 Sep 09 06:29:37.151115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 7/16] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:35 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1272 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:29:37.165507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:37.168498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:37.199879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:37.200735 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:37.201450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:37.202351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:37.203089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:37.203706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:37.624800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:37.644104 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4e5320b7-4e45-4451-8d0e-1e4a65b5477f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1279 microversion: 2.1 time: 0.487629 Sep 09 06:29:37.648961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:37 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1279 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:37.919760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] validate_networks() for [('06aa4853-deab-4da2-aa65-5023553defd4', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:38.161272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-456372013", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50724a19-0cd0-47ed-ac64-73793b689a02"}], "security_groups": [{"name": "tempest-securitygroup--1308338775"}], "key_name": "tempest-keypair-1338580225", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:38.222030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:38.752411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:39.388075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] validate_networks() for [('50724a19-0cd0-47ed-ac64-73793b689a02', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:39.401367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=12 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:40.188451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=24 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:40.372443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:40.373175 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:40.375414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:40.376020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:40.376598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:40.390040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.390783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.391357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.392259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.392864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.393564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.427712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:40.433674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for user 0a6757e5408e40cc85ad6145064d8ba7 and project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:40.449573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:40.452093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:40.532942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c7610e41-1ce1-48a5-990c-bd0f7f6d5546 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.854331 Sep 09 06:29:40.534440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 10/18] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 9 06:29:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 4859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 06:29:40.542523 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:40.543869 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:40.557417 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.558236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.558999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.560040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.560647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.561357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.789909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:40.790620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:40.791536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:40.792269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:40.792994 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:40.805375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.806511 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.807185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.808494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:40.809495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:40.810335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:40.884848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for project 7a732015d4244c378e0204e1d216f57b. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:40.901415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for user 1c86ccfec70340c797ecba83163ff1a2 and project 7a732015d4244c378e0204e1d216f57b. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:40.928786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:40.931451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:40.944294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:40.960559 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3e70edd2-dd56-4e22-90ed-1fbbc069c478 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.421668 Sep 09 06:29:40.979284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:40 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:40.995276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:40.998366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:41.016774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:41.017279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:41.018508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:41.021491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:41.022659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:41.025201 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:41.046515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3399b19f-bac7-4455-8f45-24f40b3c24a5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.893367 Sep 09 06:29:41.061129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 9/20] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:29:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:29:41.083011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:41.083876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:41.228681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:41.243078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:41.246158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:41.247504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-75956414-78c4-4b30-b3a2-b2b65a8903cf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1281 microversion: 2.20 time: 0.184682 Sep 09 06:29:41.256706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 10/21] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:41 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:41.269002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2096538946", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a1e56b2-5174-4859-ad55-8ae965984c50"}], "security_groups": [{"name": "tempest-securitygroup--1559342883"}], "key_name": "tempest-keypair-1088411147", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:41.312133 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:41.344142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-11dcb16d-7d4b-4c9b-9bdf-2c453c17faf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.362230 Sep 09 06:29:41.344778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 12/22] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:40 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:41.363836 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5a404822-e110-4621-be4c-e93e677cd50c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:41.364471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5a404822-e110-4621-be4c-e93e677cd50c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:41.452878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5a404822-e110-4621-be4c-e93e677cd50c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:41.468333 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5a404822-e110-4621-be4c-e93e677cd50c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1237 microversion: 2.1 time: 0.120840 Sep 09 06:29:41.469743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:41 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1237 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:41.506237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] validate_networks() for [('6a1e56b2-5174-4859-ad55-8ae965984c50', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:29:41.986606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:41.988427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:41.999150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.001923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.009810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.010575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.011056 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.011484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.505079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:42.531187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bb9be529-88f3-42d4-bfb2-56964897f467 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.543888 Sep 09 06:29:42.560206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:41 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:42.590793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:42.594576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:42.610228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:42.613199 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:29:42.615758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:29:42.615758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:29:42.615758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:29:42.615758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:29:42.618022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.620339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.622074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.625711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.627203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.630415 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.634097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.634827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.635456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.636659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.640582 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.649740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.740967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:29:42.781270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:29:42.794448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:42.812186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:42.820124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:42.827061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fff84426-f4a5-4dc2-bb13-2a3598b71d42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1277 microversion: 2.20 time: 0.262558 Sep 09 06:29:42.849646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:29:42.858776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:29:42.877151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 15/25] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:42 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:42.891470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:42.902909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:42.963899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.965654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.970837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.974600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:42.981821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:42.988376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:42.996323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6656b808-1729-4704-8031-011e727387e6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.736309 Sep 09 06:29:42.997169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 11/26] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:29:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:29:43.003428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:43.005075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:43.014223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:43.015076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:43.015763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:43.016792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:43.018448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:43.021026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:43.370753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:43.410154 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-72369bb4-5c7b-4fd7-be9b-5f2d36c15b96 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1233 microversion: 2.1 time: 0.410905 Sep 09 06:29:43.428971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 12/27] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:42 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1233 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:43.436336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b272a271-8830-4e62-be21-1e88e7e46cbf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:43.454778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b272a271-8830-4e62-be21-1e88e7e46cbf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:43.839109 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b272a271-8830-4e62-be21-1e88e7e46cbf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:43.851340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b272a271-8830-4e62-be21-1e88e7e46cbf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1242 microversion: 2.1 time: 0.423475 Sep 09 06:29:43.863796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 13/28] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:43 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1242 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:43.869327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:43.870352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:43.889306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:43.890117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:43.893197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:43.895976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:43.896596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:43.898806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:44.488437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:44.505743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1cd4298c-e5c2-43a5-8482-bccc8a4544f7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 1.627191 Sep 09 06:29:44.509925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:42 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:44.523473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:44.539459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:44.559274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:44.560535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:44.561716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:44.565033 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:44.566401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:44.570241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.262747 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.291876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.293625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.299774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f5c740fc-a509-4e81-a462-2d5df6a56fc2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1339 microversion: 2.20 time: 0.782184 Sep 09 06:29:45.309015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 17/30] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:44 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1339 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:45.322928 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:45.323718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:45.342239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.343443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.344149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.345159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.345819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.346474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.464512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.478325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7466ba80-e15a-415d-8630-0e2d7a5fafdb tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 1.623538 Sep 09 06:29:45.479972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 14/31] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:43 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:45.485758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:45.486843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:45.512784 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.514748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.518032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.521077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.521775 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.525615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.634262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.658454 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3bac2cc2-1b89-4aef-a1bb-9b205aa03ee2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1289 microversion: 2.1 time: 0.347877 Sep 09 06:29:45.663219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 18/32] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:45 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1289 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:45.681746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:45.682370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:45.707622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.719896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.720538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.730051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:45.730902 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:45.731361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:45.946500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:45.954843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9487ef4a-e9b1-472d-b6ab-a514b1b5f1db tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1238 microversion: 2.1 time: 0.473343 Sep 09 06:29:45.955571 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 15/33] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:45 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1238 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:46.250807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295d1588-844d-4693-9169-6269e37472d6", "tag": "a503eaba-3508-4e89-ad5d-344158d578f6"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:46.293781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:46.300496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:46.301277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:46.410424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Creating event network-changed:a503eaba-3508-4e89-ad5d-344158d578f6 for instance 295d1588-844d-4693-9169-6269e37472d6 on hv-cinder-85220 Sep 09 06:29:46.416514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 06:29:46.419377 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c7434a10-99f0-4834-a35b-964da0558766 req-7caa11e0-ab32-4b8a-b121-0015328607cd service nova] Acquired lock "compute-rpcapi-router" {{(pid=120797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 06:29:46.423280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:46.427108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:46.428874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:46.434230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:46.436376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:46.441293 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:46.473064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.compute.rpcapi [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 06:29:46.482867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120797) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 06:29:46.532320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f0d99c58-7ccf-4785-b10b-e2c1294acba2 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.568019 Sep 09 06:29:46.540721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 16/34] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:46.567348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:46.574221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:46.595101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:46.596053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:46.598533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:46.603196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:46.604315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:46.605069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:47.120659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:47.134124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:47.137113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:47.139157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fc1c8a4e-606f-477a-b75d-e6c8ce2d3ec0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1339 microversion: 2.20 time: 0.595976 Sep 09 06:29:47.141154 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 17/35] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:46 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1339 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:47.149177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:47.150072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:47.159194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:47.160896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:47.161336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:47.162302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:47.163156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:47.163780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:48.079408 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:48.106153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-db144983-d187-4dc3-b99a-b887d038f2fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 2.438657 Sep 09 06:29:48.134337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:45 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:48.149972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:48.151000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:48.161335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:48.162528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:48.163323 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:48.164277 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:48.164884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:48.165450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:48.719141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:48.732888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ccf52059-6249-40fa-bc61-3f76107ececa tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 1.590166 Sep 09 06:29:48.740714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 18/37] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:47 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:48.745941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:48.748887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:48.752366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:48.762609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:48.763923 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:48.764380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:48.765483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:48.766134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:48.766887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:48.982919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:48.996896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-eab0bd20-5bab-49e2-a26a-e83de01764b8 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1295 microversion: 2.1 time: 0.860831 Sep 09 06:29:48.997797 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 20/38] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:48 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1295 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:49.003574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:49.004276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:49.011244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.012440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.012884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:49.014425 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.014894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.015318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:49.070237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:49.082872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ac48aedd-dcca-42ab-ba9a-8ff1d129dba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1300 microversion: 2.1 time: 0.340552 Sep 09 06:29:49.086000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:48 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1300 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:49.149453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:49.150070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:49.167100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.167916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.168617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:49.169285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.169748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.170178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:49.869315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:49.881788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:49.883938 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:49.885115 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5c29629e-64df-4a00-8061-891f43915173 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.886301 Sep 09 06:29:49.885679 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:48 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:49.913264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:49.922761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d8244395-6ca1-4147-bbff-4d1f1cac7761 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.783659 Sep 09 06:29:49.924022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:49 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:49.930678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:49.931648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:49.938083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.938955 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.939887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:49.941587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:49.942421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:49.943083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.025730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad4096e8-5fde-463f-8cc2-82018a809fdb", "tag": "b1e8da49-94b9-46a5-9a14-14e91012d315"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:50.046289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.046900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.047493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.088771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Creating event network-changed:b1e8da49-94b9-46a5-9a14-14e91012d315 for instance ad4096e8-5fde-463f-8cc2-82018a809fdb on hv-cinder-85220 Sep 09 06:29:50.089575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 06:29:50.090166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-c632a0f0-6dbe-494b-8fd0-5eb33af2e004 req-3ad335ac-5198-48e4-89e9-37a456e36e5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 06:29:50.091204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.091907 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.092504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.093387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.093992 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.094678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.113880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.compute.rpcapi [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 06:29:50.113880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] Releasing lock "compute-rpcapi-router" {{(pid=120795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 06:29:50.129935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e854c769-b197-4b21-938f-b1ef080c31ed None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242923 Sep 09 06:29:50.130772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 22/42] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:50.136811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:50.147889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.148800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.149227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.164254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] Creating event network-changed:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:29:50.169514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-15bc4672-76d3-4157-953a-aeeb3db26340 req-c571bbc7-07fc-4e70-944d-f60799a63301 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037219 Sep 09 06:29:50.170294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 23/43] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:50.176830 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:50.177770 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:50.186949 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.188434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.190978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.193973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.194482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.196046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.305978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:50.314490 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-90f80a5f-0098-456f-a38d-ecb946918b00 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1295 microversion: 2.1 time: 0.142714 Sep 09 06:29:50.330260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 24/44] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:50 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:50.330420 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:50.330506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:50.330506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:50.340264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.340264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.340264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.343830 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.344595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.345272 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.349182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-400e36c6-08da-4936-9aa0-7d57ede5803b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.421708 Sep 09 06:29:50.349799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 21/45] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:49 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:50.388625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:50.473715 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:50.483192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d66c4465-b140-4f0d-a515-a0e783ccbf7d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1300 microversion: 2.1 time: 0.161828 Sep 09 06:29:50.495772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 25/46] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:50 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:50.913397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:50.915086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:50.925605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.926342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.926897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.927938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.929049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.929981 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.950838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:50.951449 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:50.962403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.964893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.965371 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:50.966062 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:50.968992 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:50.969693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.240839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.248522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2ac1553f-a389-4654-9ac8-3c780938ed19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.302072 Sep 09 06:29:51.249142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 26/47] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:50 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:51.262114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.286621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.288102 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.289268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-735d2ad6-97e5-4578-93b4-54cd36c53538 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.381037 Sep 09 06:29:51.292585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 22/48] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:50 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:29:51.340260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:51.341208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:51.352443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.353054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.353549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.354334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.355105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.356057 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.373417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:51.373853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:51.383494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.384051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.384493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.385203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.385665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.387150 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.465191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=8 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:51.614211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.618019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:51.625010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ad91f353-18c5-4b22-bba3-ebcc11442d53 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.255536 Sep 09 06:29:51.639788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.639788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3494e02f-404a-4e70-a2f8-519f0aaa797d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.302733 Sep 09 06:29:51.639788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 27/49] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:51 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:51.640756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 23/50] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:51 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:51.644777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:51.645386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:51.651199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.651765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.652208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.652953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:51.653417 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:51.653841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:51.724743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:51.733734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-823e5500-c9e2-4d77-825e-843ca4232f45 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1300 microversion: 2.1 time: 0.093187 Sep 09 06:29:51.734321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 28/51] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:51 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:52.152237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd598c3-8746-4655-aac0-948a7964ac0f", "tag": "cf6ccb53-c867-41af-9f4e-1efcea671fd8"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:52.166603 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.167177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.167746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.181463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] Creating event network-changed:cf6ccb53-c867-41af-9f4e-1efcea671fd8 for instance 1dd598c3-8746-4655-aac0-948a7964ac0f on hv-cinder-85220 Sep 09 06:29:52.187279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-e667ca51-330a-4302-9c18-576d0c72c84a req-7707aeb6-ff34-4f98-a879-f0249467c482 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038526 Sep 09 06:29:52.188272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 24/52] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:52.273020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:52.274689 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:52.282697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.283446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.284880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.285845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.286973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.287595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.317280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:52.317983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:52.324347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.324977 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.325409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.326112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.326626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.327048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.539836 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.544787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.554778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.556183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.557290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-82a5950f-9b4a-4a08-9d54-e0292544cf0c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.245571 Sep 09 06:29:52.557845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 25/53] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:52 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:29:52.559919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-592a449e-1b4e-4a38-8142-e3a3120ddadb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.292348 Sep 09 06:29:52.560528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 29/54] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:52 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:29:52.651600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:52.652591 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:52.659579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.660417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.661064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.661974 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.662858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.663743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.665750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:52.666380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:52.672357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.672844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.673491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.674383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.675694 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.676134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.884229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.891707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1bf4c58f-894e-4f96-a859-a04d2e989108 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.243999 Sep 09 06:29:52.892684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 26/55] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:52 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:52.909424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:52.910296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:52.918805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:52.919421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.919968 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.920613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.921450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:52.921922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:52.922341 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:52.931631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-832a0c7c-6352-4d9d-a2f8-05576cb4da80 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.273144 Sep 09 06:29:52.932917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 30/56] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:52 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:53.002215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:53.011919 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0e5bc483-614a-44a9-8ae2-e276eceda55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1300 microversion: 2.1 time: 0.117419 Sep 09 06:29:53.015721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 27/57] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:52 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:53.583575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:53.584229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:53.586043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:53.587180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:53.595951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:53.596493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:53.596617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:53.596945 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:53.597612 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:53.598275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:53.600756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:53.601625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:53.603090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:53.606426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:53.606932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:53.607378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:53.848151 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=16 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:54.587100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:54.594780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f66647e4-fd4c-4a62-b558-5c9b00119ee5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 1.015597 Sep 09 06:29:54.595508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 31/58] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:53 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:54.601206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:54.602370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:54.609691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:54.610338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:54.610921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:54.611775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:54.613106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:54.613740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:54.646409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:54.656207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:54.657692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:54.659694 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c580f158-6597-4e81-bc9a-8feff8079c8e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 1.079832 Sep 09 06:29:54.671980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 28/59] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:53 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:54.679200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:54.679939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:54.686555 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:54.687241 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:54.687946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:54.688652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:54.689113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:54.689539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.259224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:55.272081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-00161849-f337-4d62-bef7-a1e5590670b1 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.674283 Sep 09 06:29:55.274119 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 32/60] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:54 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:55.275285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:55.289963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d3a57589-12bf-40f7-80cb-272732220539 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.615563 Sep 09 06:29:55.290683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:55.290931 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 29/61] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:54 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:55.291313 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:55.309391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.311647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.312859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.313950 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.316202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.316749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.621332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:55.623855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:55.634245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.635234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.635682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:55.636478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.637361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.637926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.638549 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.648405 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ff7b1194-bad6-4c5d-aff4-c4250eeaba87 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1300 microversion: 2.1 time: 0.372021 Sep 09 06:29:55.664607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 33/62] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:55 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1300 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:55.686316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:55.687338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:55.703618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.704123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.704639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:55.705263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:55.710711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:55.711241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:56.460836 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:29:56.586446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:56.603100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:56.605122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:56.606397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ba6325e0-28b5-43b5-a962-2ba4e11f2d8c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.925267 Sep 09 06:29:56.613025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 34/63] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:55 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:56.620744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:56.621673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:56.629998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:56.630853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:56.631250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:56.632172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:56.632843 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:56.634404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:56.721148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:56.730203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e6c9cd49-0d5b-4a3c-8ccc-095d8a450541 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 1.114545 Sep 09 06:29:56.743765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 30/64] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:55 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:29:56.751798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:56.754325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:56.767088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:56.768017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:56.768756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:56.769772 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:56.770412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:56.771689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.074844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:57.087177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f2bc1eb6-e1c3-4bac-bd9c-7f60ae69512b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.472126 Sep 09 06:29:57.091502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 35/65] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:56 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:57.097326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:57.101241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:57.114408 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.114950 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.115876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.116184 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.117096 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.117205 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.376943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:57.387844 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-39368672-eaca-4d04-81b4-b375caa91d40 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.640941 Sep 09 06:29:57.392560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 31/66] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:56 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:57.646997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:57.649418 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:57.661532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.663315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.664171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.665845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.666476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.667671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.762088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:57.772222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3e8b139c-bc54-455c-90eb-12cc9df1c2ac tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.678980 Sep 09 06:29:57.773273 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 36/67] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:57 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:57.778341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebebb1d1-2de0-4afb-b816-797f5a4ed1ff", "tag": "2f4a6eb7-079c-4c01-b074-3e7a050153a9"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:29:57.791510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.792024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.792484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.819259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] Creating event network-changed:2f4a6eb7-079c-4c01-b074-3e7a050153a9 for instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff on hv-cinder-85220 Sep 09 06:29:57.829684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-77b61f84-03f0-4de9-9f0a-c1c8d336d9db req-abe58922-0194-4629-9070-c5c940893c2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054287 Sep 09 06:29:57.830293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 37/68] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:29:57.842347 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:57.843125 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:57.852868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.855141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.855829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:57.856855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:57.857464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:57.858150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:58.433525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:58.449466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:58.451306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:58.456112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ca3822fb-8a50-47bd-aba0-706b5a090acc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.819360 Sep 09 06:29:58.456866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 32/69] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:57 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:58.467514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:58.468101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:58.493166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:58.494525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:58.495566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:58.496593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:58.497670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:58.498274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:58.849501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:58.869061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e2eaf5b7-b0bd-42f1-9bb2-809713417d19 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 1.033096 Sep 09 06:29:58.870234 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 38/70] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:57 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:58.880767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:58.881855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:58.902688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:58.903711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:58.904262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:58.904839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:58.905295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:58.905714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.334184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.344971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5115f46b-8349-4a33-8e09-f3e4c834ba2d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.887040 Sep 09 06:29:59.349853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 33/71] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:58 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:59.373036 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:59.373853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:59.393204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.393717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.395856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.396620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.397094 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.397529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.540369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.555094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-38531ef6-534a-4cac-919b-f2f65d0ff382 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.682496 Sep 09 06:29:59.571686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 39/72] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:58 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:59.576309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:59.576917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:59.597077 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.597683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.602319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.603827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.605866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.608594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.767319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.779715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-305f1004-cb25-4366-83a8-78f5d422e7a4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.428466 Sep 09 06:29:59.790578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 34/73] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:59 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:29:59.864728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.878961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.880504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:29:59.881825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-24712702-5a4d-416e-9e40-085c2f697b05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.314025 Sep 09 06:29:59.895910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 40/74] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:29:59 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:29:59.896658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:29:59.897518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:29:59.904282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.905027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.905676 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:29:59.906936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:29:59.907608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:29:59.908344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.201653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1032ded3-aab9-4275-bad0-aef089a44bdc", "tag": "837586c2-7c46-4e73-876b-89de8eba416d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:00.214705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:00.216681 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.217181 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.217872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.235718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] Creating event network-changed:837586c2-7c46-4e73-876b-89de8eba416d for instance 1032ded3-aab9-4275-bad0-aef089a44bdc on hv-cinder-85220 Sep 09 06:30:00.247493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-368f50f9-c0a7-42fc-a15e-473ae36807e2 req-287baa1e-da32-4cf2-9ee2-44d7f1e68a37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049380 Sep 09 06:30:00.252137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 41/75] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:00.288895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:00.301954 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7c9a0d2a-5a94-47c3-9c9c-5338e7c09f6f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.410275 Sep 09 06:30:00.302618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 35/76] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:29:59 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:00.373890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:00.374581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:00.383730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.384422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.385004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.386088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.387494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.387945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.546433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:00.557308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e6888a21-4f10-4047-b297-13137dcbd99d tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.187760 Sep 09 06:30:00.558354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 42/77] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:00 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:00.582004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:00.582538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:00.588539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.589019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.589609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.590474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.591084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.591729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.790206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:00.800004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-79640020-7f3b-4289-8558-f1f9841e6863 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.222714 Sep 09 06:30:00.806022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:00.807015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:00.808167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:00 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:00.813589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.814312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.815705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.816631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.817374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.817970 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.839284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:00.907453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:00.909011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:00.917558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.918207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.918827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.920144 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:00.920864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:00.921911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:00.967422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:00.978864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-576ab324-46e1-4855-9c78-6a0ba1310b3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.176439 Sep 09 06:30:00.979764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 43/79] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:00 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:01.096902 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:01.105769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:01.107559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:01.110275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7d203247-0fbf-4ad0-93fd-5229c0744535 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.206772 Sep 09 06:30:01.110923 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 37/80] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:00 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:30:01.325805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:01.325805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:01.332513 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.333117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.333841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:01.334934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.335799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.336509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:01.501975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:01.512702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e176fad0-de34-4979-ae7e-c8e3befa7711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.191960 Sep 09 06:30:01.513387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 44/81] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:01 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:01.581989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:01.582964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:01.590800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.591300 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.591759 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:01.592454 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.592908 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.593329 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:01.738229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:01.746635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d41d1b89-299f-48d6-8383-fb205b228469 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.169544 Sep 09 06:30:01.747215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 38/82] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:01 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:01.831362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:01.832204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:01.840264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.840264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.840524 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:01.841091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:01.841708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:01.842284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.002952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:02.004006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:02.010776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.011559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.012212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.013565 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.014355 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.022306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.024972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.035048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d00608ba-400e-4faf-b4f3-650cc2108ba6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.207854 Sep 09 06:30:02.049401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 45/83] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:01 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:02.137726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:02.140166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:02.146746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.147246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.148860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.151146 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.151771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.152451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.209288 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.220438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-abb60905-f5eb-4cae-8a71-4370a1d9e9c9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.221854 Sep 09 06:30:02.221951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 39/84] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:01 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:02.338533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.348191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.350367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.352319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4c691f59-ff13-4a11-8150-e35543b63f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.218297 Sep 09 06:30:02.353608 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 46/85] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:02 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:30:02.541751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:02.547813 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:02.553018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.553895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.554882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.556047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.556829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.557559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.714648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.726334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-887239af-c697-4594-aec3-3a5140ef2b10 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.191051 Sep 09 06:30:02.727327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 40/86] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:02 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:02.770590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:02.771615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:02.777388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.778002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.778434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.779203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:02.779688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:02.780279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:02.940268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:02.951271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cccceece-96aa-4192-b57b-6a99d4d7d74c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.184438 Sep 09 06:30:02.963757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 47/87] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:02 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:03.060432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:03.061071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:03.068207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.068704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.069143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.069838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.070630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.070743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.075041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:03.245160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:03.245789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:03.252058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.253356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.254312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.255256 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.255973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.259662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.261614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:03.272901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e9e06cad-5ed0-4bbb-90b8-b54bf9489c8c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.216317 Sep 09 06:30:03.273680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 41/88] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:03 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:03.378283 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:03.379237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:03.386305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.387345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.388018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.389200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.389978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.390608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.428051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:03.446873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-50107314-59b0-452e-ab4b-783ef8425071 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.206063 Sep 09 06:30:03.460516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 48/89] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:03 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:03.585763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:03.594532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:03.598141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:03.599402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f1164f6a-7da0-4922-a449-2084e768d05a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.225657 Sep 09 06:30:03.600244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 42/90] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:03 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:30:03.751161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:03.751745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:03.762542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.763040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.763476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.764207 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.764678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.765098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.977496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:03.978958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:03.991922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.993524 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:03.997307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:03.998263 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:03.999597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.001809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:04.417746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:04.432263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1d3cabad-17b1-4de6-992b-c4db4266976b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.685423 Sep 09 06:30:04.432864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 49/91] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:03 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:04.637260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:04.645188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7fd73def-051a-49a9-ab06-ff193b13ed70 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.673864 Sep 09 06:30:04.659090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 43/92] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:03 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:04.659090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:04.659090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:04.662022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:04.662874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.663604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:04.664786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:04.665509 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.666146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:04.744246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "name": "network-vif-plugged", "status": "completed", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:04.764058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:04.764750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.765356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:04.783510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] Creating event network-vif-plugged:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:30:04.792700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-8dadee8a-0b2a-4ab1-8f67-94168cc7129d req-17253110-c6e1-41bd-b38d-806853e4aefd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.355740 Sep 09 06:30:04.794275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 50/93] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:04.803928 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:04.805063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:04.815340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:04.816255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.816996 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:04.818362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:04.819614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:04.821142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.376306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.388576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f86b97b7-8aaf-4b52-b690-e4ba2e78d845 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.737358 Sep 09 06:30:05.389745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 44/94] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:04 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:05.395905 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:05.397073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:05.416995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.418412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.419138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.420252 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.421513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.422395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.427262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.437753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-85d46499-55d3-4a25-b0ab-0b977f1c5a84 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.641991 Sep 09 06:30:05.448245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 51/95] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:04 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:05.464227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:05.466208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:05.474639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.475381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.475896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.476757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.477254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.477801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.771665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.782399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.784670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.786247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3eb970e4-de1d-4430-95bf-dee92d29d0d8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.395262 Sep 09 06:30:05.800809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 45/96] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:05 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:30:05.810164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:05.811146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:05.820235 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.820860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:05.821566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.822150 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.823186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:05.823832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:05.824651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:05.832363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1ed3499e-1483-4dca-bf42-3a2103fd5879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.375248 Sep 09 06:30:05.833718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 52/97] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:05 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:06.017069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:06.027848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bc703748-602c-466e-bd47-c6c8c37908e8 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.225698 Sep 09 06:30:06.028683 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 46/98] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:05 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:06.411915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:06.412545 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:06.418421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.418900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.419331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.420034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.420485 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.420900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.461145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:06.461753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:06.467804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.468322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.468756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.469447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.469912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.470362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.841926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:06.850930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1f8937dc-2cf2-4a46-89cc-dd183f14a211 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.442999 Sep 09 06:30:06.856690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 53/99] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:06 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:06.856843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:06.869671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9e14e0c3-fe32-4642-86c7-1b8688a81bf2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.410827 Sep 09 06:30:06.870588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:06.871333 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:06.874874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 47/100] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:06 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:06.878058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.878715 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.879298 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.880736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.881362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.881969 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.888288 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d1588-844d-4693-9169-6269e37472d6", "name": "network-vif-plugged", "status": "completed", "tag": "a503eaba-3508-4e89-ad5d-344158d578f6"}, {"server_uuid": "ad4096e8-5fde-463f-8cc2-82018a809fdb", "name": "network-vif-plugged", "status": "completed", "tag": "b1e8da49-94b9-46a5-9a14-14e91012d315"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:06.900541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.902257 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.902711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.921969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Creating event network-vif-plugged:a503eaba-3508-4e89-ad5d-344158d578f6 for instance 295d1588-844d-4693-9169-6269e37472d6 on hv-cinder-85220 Sep 09 06:30:06.923112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] Creating event network-vif-plugged:b1e8da49-94b9-46a5-9a14-14e91012d315 for instance ad4096e8-5fde-463f-8cc2-82018a809fdb on hv-cinder-85220 Sep 09 06:30:06.934893 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-49a13d29-7ede-444e-9b17-29a2ded47601 req-e7f06024-fbc8-4990-82bf-e455b7b70467 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055726 Sep 09 06:30:06.936006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 48/101] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:06.944896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:06.948226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:06.957148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.957987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.958833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:06.959885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:06.960815 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:06.962055 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.175717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:07.195939 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:07.201004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:07.203372 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-49a89136-1220-404c-b7eb-9ce3c486fe90 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1406 microversion: 2.20 time: 0.344197 Sep 09 06:30:07.204345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 54/102] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:06 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:30:07.211228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:07.212235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:07.226304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.228628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.229222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.232419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.233094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.233707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.272964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:07.281763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c2c03449-7b4e-403d-be75-5ce1551c1b22 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.343925 Sep 09 06:30:07.286221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 49/103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:06 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:07.726697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:07.745588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-730118d8-a8d7-4296-8741-427fc0273d75 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.538867 Sep 09 06:30:07.749522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 55/104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:07 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:07.880660 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:07.881303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:07.889520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.890136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.890526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.891515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.892009 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.892522 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.895223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:07.896029 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:07.903005 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.906201 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.906863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:07.908588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:07.909432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:07.910011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.183857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.192041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.209430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c38feaba-b9f4-4456-b86f-92235fee8855 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.333770 Sep 09 06:30:08.210077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 50/105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:07 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:08.221233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8146d94a-b639-48ca-b287-b0d0b826b858 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.324081 Sep 09 06:30:08.221233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 56/106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:07 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:08.235325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:08.242816 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:08.266263 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.272613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.273400 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.274463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.275069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.275690 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.319338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:08.321462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:08.337384 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.338520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.339859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.340870 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.341596 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.342170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.710063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.718088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.720318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.729058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-337cc87e-7ee9-4713-a09b-194a7039f159 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1321 microversion: 2.1 time: 0.424043 Sep 09 06:30:08.730226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 57/107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:08 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:08.731792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:08.733303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e898a046-fcee-4d60-9970-8704c498e9fc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1598 microversion: 2.20 time: 0.503211 Sep 09 06:30:08.734028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 51/108] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:30:08 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1598 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:30:08.761546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:08.762252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:08.769865 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.770655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.776052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.776415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:08.777069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.777188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:08.778258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.779053 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.784336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.784903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.785342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:08.786149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:08.786753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:08.787185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:09.029026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5fdc2904-ada5-46de-b616-529f7ef52597 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.270662 Sep 09 06:30:09.039516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 58/109] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 9 06:30:08 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:30:09.043526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd598c3-8746-4655-aac0-948a7964ac0f", "name": "network-vif-plugged", "status": "completed", "tag": "cf6ccb53-c867-41af-9f4e-1efcea671fd8"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:09.075756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:09.087086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-649927ce-e827-4580-9acb-1ca5ccb6740c tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.314621 Sep 09 06:30:09.088508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:09.089024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:09.095848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:09.098258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 52/110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:08 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:09.121331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] Creating event network-vif-plugged:cf6ccb53-c867-41af-9f4e-1efcea671fd8 for instance 1dd598c3-8746-4655-aac0-948a7964ac0f on hv-cinder-85220 Sep 09 06:30:09.130228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-ca09100d-3677-44f4-80d4-3fc4073b92e7 req-aa5511d5-9ded-41d2-bc4c-eeaffeebd56d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092180 Sep 09 06:30:09.130939 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 59/111] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:09.234879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:09.236133 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:09.242796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:09.243646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:09.245910 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:09.246762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:09.247427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:09.248725 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:09.250115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:09.250753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:09.254971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:09.255471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:09.256046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:09.257477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:09.261808 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:09.262359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.043036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:10.051359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-913dbba1-98bd-4e12-be05-3f37391a76bc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.812651 Sep 09 06:30:10.052194 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 60/112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:09 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:10.055641 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:10.066410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-926e7d4b-daae-437e-8ad8-47c99655ae18 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.835790 Sep 09 06:30:10.066987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 53/113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:09 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:10.072574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:10.073188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:10.079331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.080035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.080643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.081563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.082170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.082760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.122161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:10.122768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:10.130058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.130544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.131289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.132008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.132469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.132893 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.542688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:10.550434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:10.557877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-462c0534-75ec-4582-aaee-aa340cf7fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1514 microversion: 2.1 time: 0.488395 Sep 09 06:30:10.558565 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 61/114] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:10 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:10.584308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:10.586579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:10.593872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.594201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:10.594722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.595625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.596700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.597374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.598320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.604722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e4c31ab5-e57d-4739-beba-bdfad1cede3f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.486191 Sep 09 06:30:10.605312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 54/115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:10 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:10.638548 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'flavor' on Instance uuid ad4096e8-5fde-463f-8cc2-82018a809fdb {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:30:10.776062 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-25b5fe76-accb-4121-9d09-1071958c87fe tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb/action" status: 200 len: 32 microversion: 2.1 time: 0.197370 Sep 09 06:30:10.776795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 62/116] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:30:10 2022] POST /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 06:30:10.786826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:10.787359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:10.793312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.793805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.794489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:10.795475 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:10.796160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:10.796664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.034098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:11.042687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fefad3a9-497a-4438-baca-86a6882a4498 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.260548 Sep 09 06:30:11.043440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 55/117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:10 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:11.074930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:11.075721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:11.082328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.082891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.083519 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.084400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.084400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.084400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.091305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:11.091952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:11.103105 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.104106 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.104812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.105666 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.106170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.106589 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.597116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:11.607647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-71f5d712-251d-4d2c-a48c-2a56736f6da5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.536000 Sep 09 06:30:11.608497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 63/118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:11 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:11.628431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebebb1d1-2de0-4afb-b816-797f5a4ed1ff", "name": "network-vif-plugged", "status": "completed", "tag": "2f4a6eb7-079c-4c01-b074-3e7a050153a9"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:11.631131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:11.639315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-65101465-73c7-49e8-9b92-a3d359a9e3ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.551968 Sep 09 06:30:11.639935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 56/119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:11 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:11.643566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.644220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.645380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:11.645994 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.656088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.656585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.657216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.663865 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] Creating event network-vif-plugged:2f4a6eb7-079c-4c01-b074-3e7a050153a9 for instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff on hv-cinder-85220 Sep 09 06:30:11.669042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-d5e4e9f8-af1b-409e-bf36-bc78ea4d8f78 req-f1ff83f2-9969-4373-ba28-55d0d05cbc3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051525 Sep 09 06:30:11.669430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] Creating event network-changed:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:30:11.669718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 64/120] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:11.675400 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-32d16ac6-206d-4576-a081-6c806bc5e621 req-63b71b80-df7a-4513-9f7f-ce52db8beeb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034317 Sep 09 06:30:11.676332 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:11.676481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 57/121] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:11.677382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:11.680392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:11.684283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.684775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.685210 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.685905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:11.686361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:11.686782 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:11.819573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:11.828919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-98f97840-94c2-4380-a74d-4c7b21266ac2 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1314 microversion: 2.1 time: 0.157861 Sep 09 06:30:11.829656 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 65/122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:11 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:12.067668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:12.068403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:12.074670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.075157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.075612 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.076307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.076762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.077187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.217397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:12.226327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ed38c856-5030-4e71-8a09-cd0cce0ae456 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.163532 Sep 09 06:30:12.226907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 58/123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:12 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:12.636111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:12.637880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:12.644436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.644927 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.645413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.646116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.646574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.648192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.667254 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:12.668005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:12.674811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.676531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.677042 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.678173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.678830 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.679579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.685065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:12.851419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:12.859079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5ebd5980-20f8-4094-a452-ba97dedf2641 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.226872 Sep 09 06:30:12.859895 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 66/124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:12 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:12.865651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:12.866511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:12.872561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.873298 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.873945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.874877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:12.875571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:12.876054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:12.904529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:12.916057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-58722216-4049-49e0-9922-c1f7b0ad1882 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.252809 Sep 09 06:30:12.920135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 59/125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:12 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:13.083032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:13.091186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-891f311d-bd89-4fd2-afe3-6f2d5029e010 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1499 microversion: 2.1 time: 0.230044 Sep 09 06:30:13.091897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 67/126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:12 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1499 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:13.257629 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:13.258531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:13.266598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.268594 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.269510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.270819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.272031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.274049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.510355 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:13.521479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-876c4b9f-5995-4347-aa78-a7167ec64b9c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.268796 Sep 09 06:30:13.528174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 60/127] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:13 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:13.686380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1032ded3-aab9-4275-bad0-aef089a44bdc", "name": "network-vif-plugged", "status": "completed", "tag": "837586c2-7c46-4e73-876b-89de8eba416d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:13.697136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.697671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.698096 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.709695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] Creating event network-vif-plugged:837586c2-7c46-4e73-876b-89de8eba416d for instance 1032ded3-aab9-4275-bad0-aef089a44bdc on hv-cinder-85220 Sep 09 06:30:13.722174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-3e91f960-8f71-4c3b-a33a-0646ec41a37b req-333a38c6-a6f8-4e7f-85c4-22c57d01d2e1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039278 Sep 09 06:30:13.730566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 68/128] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:13.883575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:13.884218 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:13.901393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.901874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.904350 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.909713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.910430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.911042 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.948509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:13.949585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:13.967243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.971843 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.972776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:13.975190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:13.976103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:13.981147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:14.507736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:14.516298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5c80c638-9999-4016-85a3-8dcd30c0a93d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.636428 Sep 09 06:30:14.517560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 61/129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:13 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:14.547414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:14.547965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:14.554414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:14.556634 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:14.557123 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:14.557552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:14.558248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:14.558702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:14.559126 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:14.562955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fbea47e4-d84c-49fe-ae4b-ec25bff16b0b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.624236 Sep 09 06:30:14.563814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 69/130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:13 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:14.656792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b75202f5-935d-4ec5-a453-0613763a2a02"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:14.659719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:14.665784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:14.666265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:14.666692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:14.667373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:14.667855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:14.668268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:14.702483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:14.710761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bb09fb39-6ad6-4d0b-ae15-fc3d7700ceee tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.167305 Sep 09 06:30:14.711325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 62/131] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:14 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:15.541648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:15.543934 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:15.551913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:15.553533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:15.553997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:15.555108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:15.555871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:15.556638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:15.762057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:15.772056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d9a835e2-5862-488e-a018-975843425802 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1368 microversion: 2.1 time: 0.235032 Sep 09 06:30:15.772635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 63/132] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:15 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:15.777582 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:15.778552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:15.785540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:15.786036 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:15.786472 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:15.787170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:15.787678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:15.788601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:16.034650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:16.043069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-55286abe-e540-424b-8a3d-891e734ee47b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.269142 Sep 09 06:30:16.043704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 64/133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:15 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:16.048736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:16.049440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:16.055223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:16.055758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:16.056197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:16.056888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:16.057345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:16.057771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:16.196739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:16.208507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-17a1d3f9-51ba-4300-8cae-2892439b73cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.163485 Sep 09 06:30:16.209089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:16 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:16.795038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:16.796423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:16.802795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:16.803361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:16.803989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:16.804716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:16.805315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:16.805887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:16.960310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:16.969713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c615aad7-1555-40e1-9129-b3137d7d2ac9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1559 microversion: 2.1 time: 0.179003 Sep 09 06:30:16.975929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:16 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:16.999671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:17.000435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:17.012250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.012854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.014970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.016209 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.016808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.017629 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.146469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a65552c9-cf3a-41aa-b61b-7ce2db65cdc4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150911 Sep 09 06:30:17.147177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 67/136] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:30:16 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:17.154961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:17.154961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:17.164393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.165433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.166031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.166924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.167946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.168282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.475817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:17.492596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-537d6aa7-61cd-4d56-b57c-dc7ff3d0a8cc tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1363 microversion: 2.1 time: 0.344217 Sep 09 06:30:17.493172 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:17 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:17.501546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:17.502724 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:17.511843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:17.514314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.515305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.516505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.519376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:17.520216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:17.520803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:17.948220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:17.956718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cbe3e990-939b-43bd-8e9f-6898a4508fe9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.461318 Sep 09 06:30:17.957061 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:17 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:18.174986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c9b4b129-72a3-4c9a-abef-d4dafc6b54c4 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "POST /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.521689 Sep 09 06:30:18.192364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 70/139] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:30:14 2022] POST /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6/os-volume_attachments => generated 194 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:30:18.518064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:18.518892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:18.529302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:18.529838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:18.530453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:18.531243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:18.531978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:18.533124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:18.923832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:18.942223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-056e2154-ce91-4953-afc8-d5730bba7b0c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1550 microversion: 2.1 time: 0.428526 Sep 09 06:30:18.942808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 70/140] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:18 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1550 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:18.973265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:18.974107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:18.987576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:18.994683 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:19.002973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:19.003437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:19.006475 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:19.007295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:19.008440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:19.008641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:19.009377 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:19.010166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:19.013937 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:19.016036 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:19.016621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:19.017596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:19.426283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ba6d96fe-2897-4bba-a6cd-ced191b94f65 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.438648 Sep 09 06:30:19.441051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:30:18 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-interface => generated 285 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:19.620243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:19.636273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d4d29b92-525a-40ab-8888-beac8174a9f1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.652920 Sep 09 06:30:19.643011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 71/142] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:18 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:20.075678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1032ded3-aab9-4275-bad0-aef089a44bdc", "tag": "837586c2-7c46-4e73-876b-89de8eba416d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:20.107114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:20.113116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:20.115498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:20.157253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] Creating event network-changed:837586c2-7c46-4e73-876b-89de8eba416d for instance 1032ded3-aab9-4275-bad0-aef089a44bdc on hv-cinder-85220 Sep 09 06:30:20.177754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-d04a1830-cd4b-4172-a2b1-ba2c569ff61b req-50d79908-d8c7-478e-bc8f-b36da5bb244d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107300 Sep 09 06:30:20.196587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 72/143] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:20.666422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:20.666930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:20.675369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:20.681248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:20.681910 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:20.682821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:20.683466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:20.684083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:21.234598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:21.246698 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b22fbc41-8fbd-495d-8a80-2759dafeddac tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.583943 Sep 09 06:30:21.247216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 72/144] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:20 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:21.883534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebebb1d1-2de0-4afb-b816-797f5a4ed1ff", "tag": "2f4a6eb7-079c-4c01-b074-3e7a050153a9"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:21.900111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:21.901568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:21.902154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:21.917051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] Creating event network-changed:2f4a6eb7-079c-4c01-b074-3e7a050153a9 for instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff on hv-cinder-85220 Sep 09 06:30:21.923798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-23db763b-6ef5-4201-87c3-1ce240bb78c5 req-4f3819fd-7171-4ec5-815e-c4a70af40a58 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043759 Sep 09 06:30:21.924392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 73/145] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:22.270340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:22.270841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:22.290128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:22.290618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:22.291044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:22.291780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:22.292231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:22.292643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:22.578899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:22.589677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b80fed1a-d26d-487f-8004-821cbde94f13 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.323728 Sep 09 06:30:22.591804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 73/146] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:22 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:23.617222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:23.618465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:23.631706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:23.632919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:23.635171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:23.636020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:23.638179 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:23.638722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:23.917070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:23.927262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b11b7077-a601-40e7-8dd3-26f7f8969717 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.316367 Sep 09 06:30:23.928219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 74/147] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:23 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:24.950268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:24.950870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:24.957876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:24.958371 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:24.958798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:24.959485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:24.959969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:24.960386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:25.141044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:25.150651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8b22f32b-0362-4603-9f3f-f85f3335238c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.204082 Sep 09 06:30:25.152640 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 74/148] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:24 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:26.175971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:26.177259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:26.188055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:26.189309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:26.189901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:26.190751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:26.191367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:26.192134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:26.497686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:26.510152 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d3266f1f-056b-450a-aa4b-cad07ca3ebe4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.339253 Sep 09 06:30:26.512711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 75/149] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:26 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:27.229833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:27.230344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:27.236968 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.250525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.252202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.254054 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.254730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.255798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.297532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:30:27.325020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:27.444340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-536319bc-37f9-4dcd-a100-f8447ef593b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "DELETE /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 204 len: 0 microversion: 2.1 time: 0.217843 Sep 09 06:30:27.445458 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 75/150] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:30:27 2022] DELETE /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:30:27.453559 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:27.454238 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:27.464210 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.464709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.465147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.465851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.466314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.466732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.541039 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:27.541830 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:27.555794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.559261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.566344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.567241 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:27.569944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:27.570388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:27.861434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:27.869461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:27.876816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8d66f3aa-cfcb-4de2-bbc3-ea83d8442850 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1551 microversion: 2.1 time: 0.426541 Sep 09 06:30:27.878012 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 76/151] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:27 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1551 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:27.893326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0211b631-b209-4ac5-953f-ff7729d194dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.356643 Sep 09 06:30:27.895289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 76/152] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:27 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:28.904661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:28.905430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:28.914267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:28.914770 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:28.917438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:28.918794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:28.919309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:28.919760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:28.925051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:28.925674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:28.935101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:28.939421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:28.941473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:28.942391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:28.945406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:28.947514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:29.452784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:29.465897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:29.473094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-41b10a23-0204-45be-aac1-20bd3100efec tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1551 microversion: 2.1 time: 0.574244 Sep 09 06:30:29.480230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-61603e09-4b97-41a4-b1a5-062da6b20a92 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.566542 Sep 09 06:30:29.481389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 77/153] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:28 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:29.497416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 77/154] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:28 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1551 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:30.503082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:30.504388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:30.509406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:30.510018 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:30.520201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:30.521228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:30.521608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:30.521719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:30.522151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:30.522711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:30.522832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:30.523291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:30.523748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:30.524307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:30.525008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:30.525833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:30.550606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:30.930246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:30.960023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:30.982737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4df8bfd1-5882-4c1a-8339-6006b9f05166 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1551 microversion: 2.1 time: 0.484294 Sep 09 06:30:30.989117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:30 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1551 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:30.999650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-43b69a39-8a89-49b2-a584-8ae3b208f3e1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.470086 Sep 09 06:30:31.000492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 78/156] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:30 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:31.456371 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d1588-844d-4693-9169-6269e37472d6", "name": "network-vif-deleted", "tag": "a503eaba-3508-4e89-ad5d-344158d578f6"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:31.489772 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:31.490278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:31.492065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:31.532476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] Creating event network-vif-deleted:a503eaba-3508-4e89-ad5d-344158d578f6 for instance 295d1588-844d-4693-9169-6269e37472d6 on hv-cinder-85220 Sep 09 06:30:31.540500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-24835ed6-8bd2-4c95-9b16-f2b097966fa6 req-bed6d5a8-d953-42bd-af79-befad5ecb223 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096025 Sep 09 06:30:31.541393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 79/157] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:32.012970 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:32.014821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:32.026864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:32.027988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:32.041234 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:32.041739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:32.044085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:32.045206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:32.045471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:32.046487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:32.048188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:32.048981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:32.050084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:32.051291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:32.051520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:32.054885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:32.171199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:32.172302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:32.175326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:32.176925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lazy-loading 'fault' on Instance uuid 295d1588-844d-4693-9169-6269e37472d6 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:30:32.324741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f4d9c2505f744b4b62fffac21648f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584cd5d9848d48dea5ac9a01dbaaabf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:32.354701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-958f2de2-114b-46a9-89f3-c5e66065de6f tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 200 len: 1350 microversion: 2.1 time: 0.346063 Sep 09 06:30:32.367728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 79/158] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:32 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 1350 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:32.588718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:32.599162 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7910eb3f-c81c-42b5-a054-e29244765d5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.576614 Sep 09 06:30:32.613262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 80/159] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:32 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:33.405416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:33.415472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:33.429744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.430587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.436250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.437754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.438647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.439375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.457431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] HTTP exception thrown: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Request method failure captured: Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 HTTP/1.1 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1CZ9mEwoREnZuFJk5inN-7B44Q-70CEkSbY42HB1jIzRFCTvXx64ecfPZhqgT1SoJuYCqyD3pYSm1PG62mvN7IXDKkkQNvXnhvAWJCoMeq1Ia30pHqRsfH8BszvzNJcErdjwc7MjqktFCoNCakcrp7DHrImZ9HFD1GKil4jPLJKSE Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:30:33.462697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 5f4d9c2505f744b4b62fffac21648f0b Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.464008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '295d1588-844d-4693-9169-6269e37472d6'} Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:30:33.464673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.466476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.467786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Returning 404 to user: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:30:33.467786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-26a23873-5554-4bca-9dbc-4b020b12a423 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 404 len: 111 microversion: 2.1 time: 0.077858 Sep 09 06:30:33.467786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 80/160] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:33 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:30:33.627890 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:33.630038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:33.633678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:33.634293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:33.646191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.647515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.648144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.648842 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.649792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.650488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.651123 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.651823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.652751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:33.653387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.656088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:33.657679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:33.684778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] HTTP exception thrown: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Request method failure captured: Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6/os-volume_attachments HTTP/1.1 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1CZ9mEwoREnZuFJk5inN-7B44Q-70CEkSbY42HB1jIzRFCTvXx64ecfPZhqgT1SoJuYCqyD3pYSm1PG62mvN7IXDKkkQNvXnhvAWJCoMeq1Ia30pHqRsfH8BszvzNJcErdjwc7MjqktFCoNCakcrp7DHrImZ9HFD1GKil4jPLJKSE Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:30:33.696827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 5f4d9c2505f744b4b62fffac21648f0b Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.698337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'server_id': '295d1588-844d-4693-9169-6269e37472d6'} Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:30:33.699343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:33.701244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:30:33.703205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Returning 404 to user: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:30:33.704413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ae56b2a2-3efe-4916-9f6e-45edc8ac0e0b tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087332 Sep 09 06:30:33.708925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 81/161] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:30:33 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6/os-volume_attachments => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:30:33.915271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:33.928649 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7ada902c-e1e1-4a8b-9b15-a049252b8c97 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.301444 Sep 09 06:30:33.940004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 81/162] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:33 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:34.962707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:34.965079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:34.974124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:34.975164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:34.975859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:34.976730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:34.977495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:34.978234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:35.078530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:35.079813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:35.092957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:35.095666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:35.100999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:35.102093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:35.102797 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:35.103346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:35.142609 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] HTTP exception thrown: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Request method failure captured: Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 HTTP/1.1 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1CZ9mEwoREnZuFJk5inN-7B44Q-70CEkSbY42HB1jIzRFCTvXx64ecfPZhqgT1SoJuYCqyD3pYSm1PG62mvN7IXDKkkQNvXnhvAWJCoMeq1Ia30pHqRsfH8BszvzNJcErdjwc7MjqktFCoNCakcrp7DHrImZ9HFD1GKil4jPLJKSE Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:30:35.144923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 5f4d9c2505f744b4b62fffac21648f0b Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.146160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '295d1588-844d-4693-9169-6269e37472d6'} Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:30:35.146926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.148025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.150665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Returning 404 to user: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:30:35.151804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1cacc600-5a2d-40c7-b647-8b82873486b7 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "DELETE /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 404 len: 111 microversion: 2.1 time: 0.077314 Sep 09 06:30:35.152575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 82/163] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:30:35 2022] DELETE /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:30:35.166835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:35.176622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] [instance: 295d1588-844d-4693-9169-6269e37472d6] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:35.192664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:35.194127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:35.194806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:35.196626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:35.197650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:35.198317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:35.229930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] HTTP exception thrown: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Request method failure captured: Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 HTTP/1.1 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1CZ9mEwoREnZuFJk5inN-7B44Q-70CEkSbY42HB1jIzRFCTvXx64ecfPZhqgT1SoJuYCqyD3pYSm1PG62mvN7IXDKkkQNvXnhvAWJCoMeq1Ia30pHqRsfH8BszvzNJcErdjwc7MjqktFCoNCakcrp7DHrImZ9HFD1GKil4jPLJKSE Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:30:35.233496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/584cd5d9848d48dea5ac9a01dbaaabf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 584cd5d9848d48dea5ac9a01dbaaabf1 Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-DeleteServersTestJSON-1953108578 Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 5f4d9c2505f744b4b62fffac21648f0b Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-DeleteServersTestJSON-1953108578-project Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.234848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '295d1588-844d-4693-9169-6269e37472d6'} Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:30:35.235655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. Sep 09 06:30:35.236942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:30:35.239343 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] Returning 404 to user: Instance 295d1588-844d-4693-9169-6269e37472d6 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:30:35.241016 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-10c9a041-0028-4fee-afc3-c475ba4c3ef6 tempest-DeleteServersTestJSON-1953108578 tempest-DeleteServersTestJSON-1953108578-project] 10.222.0.25 "GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6" status: 404 len: 111 microversion: 2.1 time: 0.080362 Sep 09 06:30:35.242002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 83/164] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:35 2022] GET /compute/v2.1/servers/295d1588-844d-4693-9169-6269e37472d6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:30:35.446083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:35.459584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a15b1528-44b7-45c4-b791-af0ebb9b1afa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.504398 Sep 09 06:30:35.464649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 82/165] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:34 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:36.500532 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:36.501254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:36.523198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:36.529210 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:36.530917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:36.531787 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:36.532654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:36.533498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:37.091731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:37.105204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-73cbab1e-4b9b-4d2f-a30e-f12efab4cc77 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.614020 Sep 09 06:30:37.105896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 84/166] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:36 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:38.134180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:38.136426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:38.145085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:38.146245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:38.146996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:38.150870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:38.155122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:38.156066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:39.071865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:39.084734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c9e521b7-d0a6-4415-a995-f439d21a696b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.959246 Sep 09 06:30:39.085835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 83/167] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:38 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:40.113144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:40.115251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:40.127716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:40.130204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:40.131558 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:40.132728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:40.133432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:40.133912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:40.437663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:40.457878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ff9a12d3-360e-42e6-97ef-b185763e5497 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.351313 Sep 09 06:30:40.475653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:40 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:41.493115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:41.494494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:41.506154 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:41.507475 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:41.510011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:41.510936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:41.511622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:41.514872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:41.812236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:41.824678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7f7a7e7a-f0cd-4d77-886d-6239f735f2fb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.335832 Sep 09 06:30:41.825903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:41 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:42.351675 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3642ef3f-a8fb-4f81-8128-f2657ea336d9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Action: 'create', calling method: .version_select at 0x7f74ad164040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2075716063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj18tfB9e2j1ST2Qh19IR4178TkN2TrDwQu3zLFWNXlHy1vhrkjS1cInWggechfOtzIJiy9wUIpQilXqxfBwbshqKdIsgmIL/L3AHjq0VqRZmwmon2WjgPZ4Q7t8G/JKw=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:42.363252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=43 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:42.386297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-3642ef3f-a8fb-4f81-8128-f2657ea336d9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:30:42.396546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-3642ef3f-a8fb-4f81-8128-f2657ea336d9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for user 472b6623f57a41568fe7ffce8e40e350 and project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:30:42.452099 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3642ef3f-a8fb-4f81-8128-f2657ea336d9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.459061 Sep 09 06:30:42.457733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 86/170] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:30:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:30:42.852899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:42.856261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:42.866673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:42.869469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:42.870145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:42.871032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:42.872599 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:42.876053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:43.191202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:43.206592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b73c19c1-3fa6-49c5-b1ef-332767eeb8b5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.359245 Sep 09 06:30:43.219076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 85/171] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:42 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:44.235638 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:44.236272 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:44.249031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:44.250829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:44.250829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:44.251276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:44.258401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:44.261541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:44.649131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:44.665404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2a965590-9d2f-47e8-891f-66d6985417a1 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.434817 Sep 09 06:30:44.691325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 87/172] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:44 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:44.962137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-407815465", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:45.100356 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] validate_networks() for None {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:30:45.694386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:45.695709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:45.710040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:45.710835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:45.711811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:45.712706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:45.714836 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:45.721980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:30:45.722694 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:30:45.723423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:30:45.724200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:30:45.725206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:30:45.729039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:45.752234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:45.754554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:45.757720 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:45.761107 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:45.763242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:45.767582 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:45.856077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Getting quotas for project 6ceb527ce5a74fc98bb7ca6fcb0fabba. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:30:45.862874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Getting quotas for user 902e421fe49444318dace820aaa881f2 and project 6ceb527ce5a74fc98bb7ca6fcb0fabba. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:30:45.879004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:30:45.881979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:30:46.005179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d1eea06c-2db1-4a7e-a4ef-95378058de71 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059253 Sep 09 06:30:46.013967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 86/173] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:30:46.021366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-76d19169-7676-4dd3-b0d6-e1875f66fc31 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:46.027098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-76d19169-7676-4dd3-b0d6-e1875f66fc31 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:46.153120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-76d19169-7676-4dd3-b0d6-e1875f66fc31 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:46.161712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-76d19169-7676-4dd3-b0d6-e1875f66fc31 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1214 microversion: 2.1 time: 0.146256 Sep 09 06:30:46.162529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 87/174] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:46 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:46.164163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:46.191848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4c108fa9-cdbc-4f58-a2b8-342edb286f63 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.500735 Sep 09 06:30:46.208512 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 88/175] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:45 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:47.190443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:47.191913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:47.199168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:47.200147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:47.200774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:47.201675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:47.202328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:47.202753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:47.225825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:47.227106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:47.239572 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:47.243429 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:47.245204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:47.246194 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:47.248055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:47.249945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:47.277637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:47.298417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bb4fe67f-5628-4965-ad5a-07c04f8aa050 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1210 microversion: 2.1 time: 0.114138 Sep 09 06:30:47.314729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 88/176] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:47 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:47.477659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:47.492814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5e4076f8-a3f9-4cc5-ba94-aaa954d1d981 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.270292 Sep 09 06:30:47.493433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 89/177] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:47 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:48.324461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:48.327331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:48.329567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:48.337181 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:48.337732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:48.338386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:48.339203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:48.339749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:48.340237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:48.444467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:48.452839 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c1c4c58c-0112-4324-b9b3-c60448141458 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1272 microversion: 2.1 time: 0.133901 Sep 09 06:30:48.453539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 89/178] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:48 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:48.518152 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:48.518798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:48.525904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:48.526761 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:48.527464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:48.528294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:48.528757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:48.529181 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:48.775488 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:48.786565 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7591a731-0fe0-4857-ab55-313b6885bc69 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.274291 Sep 09 06:30:48.787431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 90/179] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:48 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:49.486158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:49.487619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:49.505186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:49.505723 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:49.508171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:49.510625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:49.514827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:49.516375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:49.816570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:49.817621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:49.828204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:49.828947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:49.829701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:49.830992 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:49.831535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:49.832075 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:49.849076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:49.862639 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fbcf4b55-f58d-4e13-83a4-175fdc7bcdf1 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.390307 Sep 09 06:30:49.863376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 90/180] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:49 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:50.033905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:50.043149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac62f21d-5ad4-4d37-8031-415a89417254 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.235162 Sep 09 06:30:50.043931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:49 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:50.123649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd5a6405-76ee-4dde-bc90-86847991a88e", "tag": "397c11aa-2b32-47e8-9b8a-6f533df788c4"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:50.136647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:50.137134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:50.137564 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:50.150985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] Creating event network-changed:397c11aa-2b32-47e8-9b8a-6f533df788c4 for instance dd5a6405-76ee-4dde-bc90-86847991a88e on hv-cinder-85220 Sep 09 06:30:50.156087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-a8e9b0d0-9830-411f-a38e-15b8985b477a req-4973415b-23cf-4e20-8ee5-0daf36c952db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Sep 09 06:30:50.156747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 91/182] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:30:50.886145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:50.886683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:50.893188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:50.893683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:50.894126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:50.894812 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:50.895269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:50.895754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:51.039044 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:51.046888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-81e8170d-a895-4aa2-b177-78e78df75df3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.164596 Sep 09 06:30:51.047460 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 92/183] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:50 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:51.068496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:51.069428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:51.079935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:51.084310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:51.084967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:51.085845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:51.086534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:51.090191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:51.233262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:51.241402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cf2e746c-5ad2-40e7-9169-ca5e6017260b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.177233 Sep 09 06:30:51.241973 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 92/184] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:51 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:52.069390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:52.070117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:52.076816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:52.077257 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:52.078251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:52.079082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:52.079561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:52.079990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:52.227803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:52.237302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a6ec9f1f-a0e7-4c17-9f98-d566695dbfd0 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.171750 Sep 09 06:30:52.237877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 93/185] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:52 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:52.264813 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:52.266373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:52.272028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:52.272509 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:52.272939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:52.273620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:52.274076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:52.274496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:52.423326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:52.432334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c1a34ae9-97ba-4a5c-8e9a-9169ca32bbd6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.171275 Sep 09 06:30:52.435457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 93/186] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:52 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:53.260535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:53.261296 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:53.263247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:53.270187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:53.270860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:53.271370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:53.272341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:53.272915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:53.273411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:53.458679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:53.459267 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:53.466302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:53.466794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:53.467222 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:53.467937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:53.468427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:53.469152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:53.472787 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:53.481383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-52a9f32a-567a-41a6-9b22-eff738977e74 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.224837 Sep 09 06:30:53.482463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:53 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:53.623222 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:53.627873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:53.633107 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7ccf072d-708a-4d2a-9dd0-46a2669e16a7 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1520 microversion: 2.1 time: 0.178279 Sep 09 06:30:53.634331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 94/188] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:53 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:54.506922 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:54.507562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:54.515078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.515786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.516258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:54.516964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.517428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.517855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:54.657337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:54.658563 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:54.659434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:54.666260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.667058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.667746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:54.667887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8dc3e915-7561-4030-8e35-c7fede50824e tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.165708 Sep 09 06:30:54.668401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 95/189] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:54 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:54.668985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.669538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.670162 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:54.816365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:54.824281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-155a0372-db1d-4ca3-be3d-f2b3f129ee45 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1500 microversion: 2.1 time: 0.171159 Sep 09 06:30:54.824951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 95/190] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:54 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:54.847032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:54.847701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:54.853958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.854444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.854881 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:54.858734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:54.859602 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:54.860114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:55.003014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:55.017550 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-35a9494a-2882-42eb-b992-a22391d9fe1a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1515 microversion: 2.1 time: 0.174880 Sep 09 06:30:55.018218 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 96/191] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:54 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:55.690304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:55.691071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:55.698295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:55.698798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:55.699231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:55.700248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:55.700712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:55.701163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:55.797702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:55.848112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:55.856893 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4fe86129-eb07-4a25-8c61-cf98ce50a395 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.170468 Sep 09 06:30:55.857473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 96/192] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:55 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:56.460765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:56.463090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:56.469636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.470122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.470554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:56.471242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.471728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.472153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:56.491352 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:56.497182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'flavor' on Instance uuid 1dd598c3-8746-4655-aac0-948a7964ac0f {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:30:56.571897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9163000f-3edc-4b2c-a572-c22df68681f0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/action" status: 200 len: 32 microversion: 2.1 time: 0.115124 Sep 09 06:30:56.572504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 97/193] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:30:56 2022] POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/action => generated 32 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:30:56.583728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:56.584470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:56.586444 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=8 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:30:56.592046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.592636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.593389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:56.593967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.594517 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.595021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:56.833294 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:56.841404 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-69b0ce5d-06d3-450e-9500-e5d3c09deaaa tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.262897 Sep 09 06:30:56.841999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 97/194] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:56 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:56.880886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:56.881614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:56.888017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.888510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.888945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:56.889637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:56.890170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:56.890685 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:57.086321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:57.096226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7771156a-a797-4b21-82e5-5219651012f9 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.219846 Sep 09 06:30:57.113431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 98/195] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:56 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:30:57.142923 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5a6405-76ee-4dde-bc90-86847991a88e", "name": "network-vif-plugged", "status": "completed", "tag": "397c11aa-2b32-47e8-9b8a-6f533df788c4"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:30:57.153729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:57.155092 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:57.155576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:57.177877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] Creating event network-vif-plugged:397c11aa-2b32-47e8-9b8a-6f533df788c4 for instance dd5a6405-76ee-4dde-bc90-86847991a88e on hv-cinder-85220 Sep 09 06:30:57.185226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-492717bf-b531-4a6e-8a68-3bff9a9d82fe req-75e41f9f-51dc-4311-a69a-84cdad181abc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047011 Sep 09 06:30:57.185961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 98/196] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:30:57.866341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:57.866951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:57.876902 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:57.878278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:57.878428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:57.879389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:57.880128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:57.881062 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:58.044235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:58.052379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-18920ab3-969e-408d-96c7-1b78d002622f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.190414 Sep 09 06:30:58.052962 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 99/197] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:57 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:58.121470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:58.122077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:58.129096 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:58.129585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:58.130021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:58.130709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:58.131168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:58.131617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:58.265741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:58.273538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-db29e016-9211-4d42-957b-fdb275e4f5c7 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1314 microversion: 2.1 time: 0.156348 Sep 09 06:30:58.274108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 99/198] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:58 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:58.890858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:58.891433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:58.897848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:58.898340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:58.898801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:58.899494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:58.899974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:58.900490 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:58.925239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e87604c4-2231-45de-ba99-d042a60d3c5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/ips" status: 200 len: 152 microversion: 2.20 time: 0.038720 Sep 09 06:30:58.925803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 100/199] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Sep 9 06:30:58 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:30:59.078993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:59.080097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:59.090793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.091491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.092631 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.093311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.093934 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.094593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.270196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:59.280557 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-04dd60ce-a877-4e26-af0d-08acd0599202 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.207722 Sep 09 06:30:59.282021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 100/200] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:59 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:59.298294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:59.299369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:59.308682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.308682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.308682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.308682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.309123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.309123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.465571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:59.474502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ccca50ba-0ddf-46ac-bfe2-0d17ebe465f3 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1463 microversion: 2.1 time: 0.181385 Sep 09 06:30:59.475066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 101/201] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:59 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:30:59.528368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:59.529314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:59.536572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.537066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.537566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.538276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.538811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.539236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.568083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:30:59.665112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8a47cb05-3391-4016-8132-510b4bd670da tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 204 len: 0 microversion: 2.1 time: 0.140633 Sep 09 06:30:59.665807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:30:59 2022] DELETE /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:30:59.675017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:30:59.675696 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:30:59.682960 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.683450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.683903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.684604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:30:59.685056 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:30:59.685472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:30:59.822015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:30:59.830675 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2869ba69-84cf-4b24-bf53-b20877f1da96 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1469 microversion: 2.1 time: 0.159994 Sep 09 06:30:59.831242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 102/203] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:30:59 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:00.309124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:00.309815 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:00.316851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:00.317332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:00.317762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:00.318439 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:00.318890 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:00.319304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:00.448820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:00.456505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c7360911-9a8b-4738-999a-fdf0b9270cf6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.151621 Sep 09 06:31:00.457072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:00 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:00.854430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:00.855066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:00.862363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:00.862853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:00.863285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:00.864017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:00.864473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:00.864931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:00.996771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:01.007232 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0c7feec1-4122-42f3-b4db-1cf7cb4209be tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1469 microversion: 2.1 time: 0.156577 Sep 09 06:31:01.008368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 103/205] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:00 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:01.479073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:01.479803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:01.487146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:01.487672 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:01.488111 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:01.488844 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:01.489304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:01.489733 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:01.641810 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:01.649621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-440f91d1-6bf2-47bd-8537-253e813bbf60 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.174509 Sep 09 06:31:01.650210 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 103/206] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:01 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:02.035738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:02.036693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:02.043623 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.044196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.044652 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.045403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.045999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.046538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.275227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:02.294628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cdfdb057-29ba-4b2a-b003-b095c44afa4a tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1469 microversion: 2.1 time: 0.259000 Sep 09 06:31:02.298213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 104/207] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:02 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:02.344501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:02.345111 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:02.352397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.353042 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.353511 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.354215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.355009 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.355624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.381714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'flavor' on Instance uuid 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:31:02.468959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd5a6405-76ee-4dde-bc90-86847991a88e", "name": "network-vif-deleted", "tag": "397c11aa-2b32-47e8-9b8a-6f533df788c4"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:02.489759 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.490802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.491760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.507299 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] Creating event network-vif-deleted:397c11aa-2b32-47e8-9b8a-6f533df788c4 for instance dd5a6405-76ee-4dde-bc90-86847991a88e on hv-cinder-85220 Sep 09 06:31:02.514398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-743a01e4-dba4-4d0b-9a0d-669ebff0c23d req-fbb2fbfd-fa0c-4967-907c-3f3fd803c438 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049886 Sep 09 06:31:02.516206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 105/208] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:02.675360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:02.676164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:02.683052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.683962 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.684395 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.685385 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.685998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.687051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.716075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ae48b306-5421-4292-9cd7-044c23b7dd5d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/action" status: 202 len: 0 microversion: 2.20 time: 0.376372 Sep 09 06:31:02.716678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 104/209] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 9 06:31:02 2022] POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:31:02.726736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:02.727449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:02.737182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.738788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.739991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.740998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:02.741159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:02.741820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:02.926678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:02.940837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ae050c12-a6c7-4fe8-a0d0-f11568908bcc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.270962 Sep 09 06:31:02.942039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 106/210] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:02 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:02.957043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:02.968260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:02.971713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:02.971713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8984cdb3-426f-44a2-aa12-a68d5284565b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.249566 Sep 09 06:31:02.971913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 105/211] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:02 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:03.318190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:03.318809 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:03.325360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:03.325847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:03.326288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:03.326987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:03.328043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:03.328498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:03.364606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:03.365176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:03.365608 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:03.366043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lazy-loading 'fault' on Instance uuid dd5a6405-76ee-4dde-bc90-86847991a88e {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:31:03.413710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902e421fe49444318dace820aaa881f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ceb527ce5a74fc98bb7ca6fcb0fabba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:03.423231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3d21f302-03aa-46f3-9671-6d92cbdf865d tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 200 len: 1304 microversion: 2.1 time: 0.108823 Sep 09 06:31:03.423941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 107/212] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:03 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:03.965122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:03.965848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:03.974463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:03.975037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:03.976219 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:03.977040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:03.977380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:03.977797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.011028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:04.011945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:04.023064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.023858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.024775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.025758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.026485 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.027073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.183783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:04.192004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bfcc84f7-b42c-491e-9c35-b77de44e5cd9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.230685 Sep 09 06:31:04.203569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 106/213] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:03 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:04.203569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1418006417", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2075716063", "security_groups": [{"name": "tempest-secgroup-smoke-959218854"}], "block_device_mapping_v2": [{"uuid": "7ac16319-6dd4-435e-bd3a-9ccd1651b45e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7964840-3c67-4db0-a5fd-d0b8ff555b07"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:04.217461 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:04.230707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:04.233941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:04.236034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-885bdfa2-e373-4736-acbd-16f60e5f4530 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.229259 Sep 09 06:31:04.239583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 108/214] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:04 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:04.351291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] validate_networks() for [('a7964840-3c67-4db0-a5fd-d0b8ff555b07', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:31:04.446334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:04.447171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] [instance: dd5a6405-76ee-4dde-bc90-86847991a88e] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:04.454496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.455249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.455708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.456561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.457354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.457783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.472395 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] HTTP exception thrown: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Request method failure captured: Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e HTTP/1.1 Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt2Scd1ptMhGkI7MujL1nCKAyP5izjUgwjUY1UNpJP31b5xD7frLQ0PW_a5ACdzs00cbQ0sOtV0Hdu0kJii156zf7d4Ow8hv10MAQAyTldpx-5nDC_8khbXLzaIS3UuOM5cV_hZmXDmHhrCVl144NqfNQW0AVCNgtCf7uH2tcKVFodU Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 6ceb527ce5a74fc98bb7ca6fcb0fabba Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesNegativeTest-1644817659 Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:31:04.474295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ceb527ce5a74fc98bb7ca6fcb0fabba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_6ceb527ce5a74fc98bb7ca6fcb0fabba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/6ceb527ce5a74fc98bb7ca6fcb0fabba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/6ceb527ce5a74fc98bb7ca6fcb0fabba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesNegativeTest-1644817659 Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 6ceb527ce5a74fc98bb7ca6fcb0fabba Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesNegativeTest-1644817659 Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesNegativeTest-1644817659-project Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 902e421fe49444318dace820aaa881f2 Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesNegativeTest-1644817659-project Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. Sep 09 06:31:04.475847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'dd5a6405-76ee-4dde-bc90-86847991a88e'} Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:31:04.476687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. Sep 09 06:31:04.478020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:31:04.480227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] Returning 404 to user: Instance dd5a6405-76ee-4dde-bc90-86847991a88e could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:31:04.481075 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2a090dda-3663-403b-a7a8-20cd1b083f09 tempest-VolumesNegativeTest-1644817659 tempest-VolumesNegativeTest-1644817659-project] 10.222.0.25 "GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e" status: 404 len: 111 microversion: 2.1 time: 0.038853 Sep 09 06:31:04.481815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 109/215] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:04 2022] GET /compute/v2.1/servers/dd5a6405-76ee-4dde-bc90-86847991a88e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:31:04.771456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:31:04.772164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:31:04.772837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:31:04.773247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:31:04.773659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:31:04.783281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.783805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.784238 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.785379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:04.785657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:04.786069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:04.804117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:04.808423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for user 472b6623f57a41568fe7ffce8e40e350 and project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:04.876799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:31:04.879838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ac16319-6dd4-435e-bd3a-9ccd1651b45e',volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:31:05.048216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1f43dfff-5f0f-455a-a3c8-ec050be217a9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.854367 Sep 09 06:31:05.055495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 107/216] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:31:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:31:05.063213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-751abc7d-ab0c-4a80-8421-ead753f727a2 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:05.065768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-751abc7d-ab0c-4a80-8421-ead753f727a2 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:05.161459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-751abc7d-ab0c-4a80-8421-ead753f727a2 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:05.168431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-751abc7d-ab0c-4a80-8421-ead753f727a2 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1095 microversion: 2.1 time: 0.111777 Sep 09 06:31:05.176688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 110/217] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:05 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:05.218553 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:05.219365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:05.228883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:05.229667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:05.230250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:05.231205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:05.231875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:05.232302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:05.262354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:05.262966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:05.269770 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:05.270265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:05.270731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:05.271435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:05.271971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:05.272399 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:05.464997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:05.475373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e7195da2-094c-479b-a3db-d87e2e5482af tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.261146 Sep 09 06:31:05.492236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 108/218] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:05 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:05.503201 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:05.513085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:05.515501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:05.516959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1f37bf82-e1ce-4099-a590-8ee403159d2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.258501 Sep 09 06:31:05.517606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 111/219] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:05 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:06.192186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:06.192938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:06.200217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.200953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.201486 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:06.202267 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.202796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.203309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:06.207760 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:06.290010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:06.298065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a0471035-4d88-437e-a896-db0f883a86d4 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1193 microversion: 2.1 time: 0.109624 Sep 09 06:31:06.298838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 109/220] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:06 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:06.501649 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:06.503603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:06.511725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.512288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.512794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:06.513620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.514144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.515172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:06.550636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:06.551082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:06.560227 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.561136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.562403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:06.563526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:06.564853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:06.565889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.112586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:07.119754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:07.124849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f18ff87c-851f-474b-9398-27c1b112fea2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.627738 Sep 09 06:31:07.126093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 112/221] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:06 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:07.130525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:07.131984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:07.133128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4cb54838-20b9-4aab-a09e-505cec32c997 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.593276 Sep 09 06:31:07.133806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 110/222] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:06 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:07.321949 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:07.322563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:07.328548 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.329035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.329941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.331031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.331525 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.331984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.350118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:07.350609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:07.356646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.357338 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.357945 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.361817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.361817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.361817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.390198 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7af72193-c4c6-44a8-ac32-00bc3edecaa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/ips" status: 200 len: 151 microversion: 2.1 time: 0.043816 Sep 09 06:31:07.390804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 111/223] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:31:07 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:07.395709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:07.396596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:07.405443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.406148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.406599 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.407306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:07.407798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:07.408226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:07.415328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:07.429404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8fc6d8fb-ca62-4399-8aed-f22ab4b66205 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1211 microversion: 2.1 time: 0.111155 Sep 09 06:31:07.429991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 113/224] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:07 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:07.439394 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d4078a9c-c43a-4ae2-912c-00c9c022ae5c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/ips" status: 200 len: 147 microversion: 2.1 time: 0.046742 Sep 09 06:31:07.447679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 112/225] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:31:07 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/ips => generated 147 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:08.147875 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:08.148523 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:08.155378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.155898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.156336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.157027 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.157486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.157909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.158250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:08.158861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:08.166313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.166809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.167246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.167979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.168444 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.168875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.183677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:08.362728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:08.365798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:08.370530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9553a1d7-98ae-4d83-bd75-9119989d730e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.226468 Sep 09 06:31:08.371103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 114/226] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:08 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:08.374677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:08.376159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:08.377315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f9b97575-d3d4-4275-b521-89a047f6e35d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.223073 Sep 09 06:31:08.377857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 113/227] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:08 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:08.453393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:08.453901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:08.459738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.460220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.460651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.461338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:08.461819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:08.462239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:08.523981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:08.531758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ae0d921d-72bf-4459-bdd2-e2a7b7767300 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1211 microversion: 2.1 time: 0.082382 Sep 09 06:31:08.532318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 115/228] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:08 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:09.394312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:09.394921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:09.401431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.401920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:09.402364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.402364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.402567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:09.403031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.403488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.403938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.409903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.410381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.410833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.411510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.411986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.412401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.599924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:09.608619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-00dcaeed-a4d2-40d8-9dbd-4fb9831d1f53 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.217464 Sep 09 06:31:09.609390 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 114/229] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:09 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:09.626217 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:09.628522 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:09.629585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:09.635532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.636082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.636633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.637492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.638124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.638944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.639641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:09.642892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:09.645222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-be4fe88a-88e7-4c37-ad7d-157b5c021819 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.246817 Sep 09 06:31:09.646089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 116/230] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:09 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:09.722879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:09.730684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8f4a3271-1037-4c22-9ec6-3912625e657d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1211 microversion: 2.1 time: 0.106792 Sep 09 06:31:09.731253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 115/231] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:09 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:09.872776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bd833cd-802b-47a5-83d0-6d74f9352d7a"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:09.875259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:09.881498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.881982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.882480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:09.883176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:09.883674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:09.884098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:10.194793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fc7e6289-d98e-4a22-a414-66595d086752 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326146 Sep 09 06:31:10.201177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 117/232] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:31:09 2022] POST /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:10.632773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:10.633232 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:10.639424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:10.640518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:10.641374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:10.642403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:10.643169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:10.643908 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:10.675345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:10.676082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:10.682517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:10.682906 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:10.683579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:10.684279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:10.684783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:10.685213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:10.961627 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:10.975707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-793adf64-adb9-4e30-94c9-dbc001fc0c76 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.346969 Sep 09 06:31:10.977519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 116/233] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:10 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:10.999072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:11.005675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:11.032748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:11.037808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:11.038314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:11.038746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:11.039647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:11.040109 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:11.040936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:11.048658 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:11.050629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:11.053049 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f8680241-9222-4766-a01f-946a40f494ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.383477 Sep 09 06:31:11.053758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 118/234] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:10 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:11.241854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be567a31-4455-4dc6-8be1-937ae81a8dbb", "tag": "1b544ee4-2fba-476c-b109-803fa6e71594"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:11.266845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:11.267439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:11.268007 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:11.284077 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] Creating event network-changed:1b544ee4-2fba-476c-b109-803fa6e71594 for instance be567a31-4455-4dc6-8be1-937ae81a8dbb on hv-cinder-85220 Sep 09 06:31:11.291312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-3213c1ba-214e-4720-ba8d-238adb016f26 req-3c917c9f-3545-46eb-b1bc-7fe3e2e30632 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053088 Sep 09 06:31:11.293224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 119/235] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:11.386432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:11.396207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c079661a-8b4d-48d8-b368-44817da08bc1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.417573 Sep 09 06:31:11.397433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 117/236] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:10 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:12.002486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:12.003247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:12.009971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.010501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.011028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.011992 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.012655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.013107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.087483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:12.088145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:12.095801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.096626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.097304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.098223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.099186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.099915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.297640 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:12.305644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-913c05a4-1b17-4cb5-8b40-966e065d2711 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.307921 Sep 09 06:31:12.312199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 120/237] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:11 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:12.320356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f07674-2e81-492e-84eb-0f1278842421"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:12.323196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:12.330499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.330989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.331419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.332684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.333297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.333718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.375370 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:12.384142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:12.387716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:12.389951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-865ba2f0-71ae-4e8f-a2b1-187786d632c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.308558 Sep 09 06:31:12.407578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 118/238] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:12 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:12.423612 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:12.424401 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:12.430687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.431358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.433459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.434192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:12.437503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:12.437987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:12.689851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9335f81f-a18b-45e3-abaf-40df8d28c17c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381802 Sep 09 06:31:12.690746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 121/239] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:31:12 2022] POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:12.767255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:12.786601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b597232b-0395-4ae6-ab40-bac5809d84e6 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.369670 Sep 09 06:31:12.787569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 119/240] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:12 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:13.331229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:13.332182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:13.334373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:13.339867 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.340448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.340955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:13.341738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.342353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.342899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:13.422506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:13.423801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:13.433620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.434660 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.440762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:13.443347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.446068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.447536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:13.573535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:13.583912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c9c97260-7b48-4df3-b102-32142ea9cb2f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.258235 Sep 09 06:31:13.584642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 122/241] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:13 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:13.614383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:13.622925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:13.625595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:13.626424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6a1b18db-2e1b-4e31-a7ca-0923d974b9b7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.208298 Sep 09 06:31:13.626981 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 120/242] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:13 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:13.813723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:13.814742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:13.823723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.824477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.825271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:13.826179 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:13.827168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:13.828023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:14.016885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:14.024715 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3a687d4f-41d9-41df-a0cd-150102a69c33 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.219527 Sep 09 06:31:14.025299 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 123/243] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:13 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:14.608660 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:14.609538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:14.615681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:14.616174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:14.616608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:14.617301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:14.618166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:14.618597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:14.653187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:14.653954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:14.661594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:14.662085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:14.662515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:14.663211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:14.663695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:14.664113 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:14.776479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:14.787452 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-eaee1339-0575-46bf-8280-1f8820edfb90 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.182690 Sep 09 06:31:14.791596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 121/244] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:14 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:14.949466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:14.965515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:14.967969 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:14.969372 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-efeb54a8-ce82-4d28-a991-5a4aa551eda6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.321578 Sep 09 06:31:14.970352 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 124/245] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:14 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:15.049230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:15.049985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:15.051961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:15.052744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:15.059157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.059886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.060266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.061020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.061485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.061911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.088720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-996289467", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "networks": [{"uuid": "13f47cc6-2087-46cd-8f70-e93a65643080"}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:15.151214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] validate_networks() for [('13f47cc6-2087-46cd-8f70-e93a65643080', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:31:15.167955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:15.283486 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:15.292978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8e9a41e4-777d-400d-a527-49a7229375db tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.249370 Sep 09 06:31:15.293701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 122/246] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:15 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:15.813919 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:15.815273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:15.817713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:31:15.818905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:31:15.819486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:31:15.820000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:31:15.820354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:31:15.831801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.832288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.832722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.833506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.833909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.834326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.837459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.838072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.838879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.840437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:15.840954 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:15.841354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:15.852448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Getting quotas for project 9c96a5a4edc84b70a31c6b0cd2a8f864. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:15.857314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Getting quotas for user 4659e9d9c65e436aa101db62a801a5fe and project 9c96a5a4edc84b70a31c6b0cd2a8f864. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:15.872993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:31:15.877174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:31:15.927379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d2ef36d1-aa7a-4ef4-a245-f8ca556f6478 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843440 Sep 09 06:31:15.928293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 125/247] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 06:31:15.940412 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8c880565-2ed9-4933-8f3b-a889a6565930 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:15.947507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8c880565-2ed9-4933-8f3b-a889a6565930 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:16.018350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8c880565-2ed9-4933-8f3b-a889a6565930 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.026929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8c880565-2ed9-4933-8f3b-a889a6565930 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1218 microversion: 2.1 time: 0.090679 Sep 09 06:31:16.027529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 126/248] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:15 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:16.048143 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:16.049741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:16.059593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:16.059593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:16.059593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:16.059593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:16.059965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:16.059965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:16.269910 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.277028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.278241 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0c744ad1-5340-4948-a911-09b142ff048d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.469577 Sep 09 06:31:16.279418 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 123/249] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:15 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:16.288269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.289910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.291493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e80b22d2-9b58-40d7-a40a-26ae486cda59 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.248171 Sep 09 06:31:16.292229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 127/250] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:16 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:16.318025 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:16.319527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:16.330001 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:16.331050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:16.331765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:16.332919 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:16.333471 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:16.334082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:16.538198 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:16.546178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ea431018-f300-45e2-aa48-dd6c41d9509e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.233368 Sep 09 06:31:16.546746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 124/251] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:16 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:17.050249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:17.050860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:17.057795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.058285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.058724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.059433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.059920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.060345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.131137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.139030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-395e6a14-bb71-44ce-87cf-23837dacff3a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1214 microversion: 2.1 time: 0.092643 Sep 09 06:31:17.140069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 128/252] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:17 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:17.302228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:17.303583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:17.311538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.316513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.317441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.319287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.320665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.322502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.330003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:17.330861 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:17.345750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.346377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.346876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.347691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.350045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.351459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.532907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.540812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6b9e03f9-8efa-415b-964c-c0a63b56a979 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.242403 Sep 09 06:31:17.541492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 125/253] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:17 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:17.556988 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.567538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.568797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:17.569106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.569627 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:17.570269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-567f66b0-0a90-4cbb-b81a-cdd972b4e84d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.246480 Sep 09 06:31:17.570903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 129/254] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:17 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:17.575910 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.576697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.577239 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.578008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:17.578544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:17.579040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:17.597165 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:17.747930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:17.756493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-374eb28d-4477-4735-a092-7b7f66bc1247 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.191778 Sep 09 06:31:17.757055 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 126/255] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:17 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:17.851042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-03154fbd-a92d-40b8-bdd0-26610d7f1595 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: .version_select at 0x7f74ad16b700>, body: {"keypair": {"name": "tempest-keypair-410572750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQPKZcLBeusJxZN1Ebaj0lARPp/C+T9tS0fdZ2fbPcyrHB2oqyFunGgbGq00vG0IPZ2vlX5U2OwSaGQgYhn7xv/VYW+/MuzzW4Lh7stxuJwRha2+zFvnSlPBdyq/SAt9A=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:17.867144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-03154fbd-a92d-40b8-bdd0-26610d7f1595 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:17.871067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-03154fbd-a92d-40b8-bdd0-26610d7f1595 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:17.893577 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-03154fbd-a92d-40b8-bdd0-26610d7f1595 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046746 Sep 09 06:31:17.894177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 130/256] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:31:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:18.164572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:18.166329 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.185227 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.187127 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.188235 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.189576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.195062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.195806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.275506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:18.285972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a812cae2-3067-4f21-b621-5f22b553aa72 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1270 microversion: 2.1 time: 0.126730 Sep 09 06:31:18.287171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 127/257] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:18 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:18.565916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:18.567359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.574450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.575257 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.575989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.577134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.577758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.578243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.597001 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:18.597772 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.600128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:18.605559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.606539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.607203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.608801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.609499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.610178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.832970 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:18.836530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:18.841486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-839824c6-011e-4aad-92ef-f1f847d708c4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1501 microversion: 2.1 time: 0.280946 Sep 09 06:31:18.842126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 131/258] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:18 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:18.847586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:18.848420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.858048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:18.862694 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.863393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.864067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.864950 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.865582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.866170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.868654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:18.870231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:18.871392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f982fe67-af0b-412c-bf13-79f4ea897150 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.278598 Sep 09 06:31:18.872072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 128/259] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:18 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:18.877869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c9a4aea-2ef2-4c27-bf97-ca1f2f192263"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:18.880502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.887121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.887877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.888513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.890324 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.891031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.891665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.937823 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] HTTP exception thrown: Cannot 'attach_volume' instance 1dd598c3-8746-4655-aac0-948a7964ac0f while it is in vm_state rescued Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Request method failure captured: Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/os-volume_attachments HTTP/1.1 Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 74 Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1AGUILD7DmLsRt9aOu-ikMi1F0qGBHhXrTQ-5XEIwFapJRgo8vsHmPk_UHXcLVq0KtG6BGuztRCoJe4rfPIQIG3QNjuh6Yn3ENa8VU3hcBQ7GoOwtMQP0oWKFVFSy19m52T1JZd8PYkuYsKUYhlja-kZv6XszXUOaBOKyA5PZdxww Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:31:18.939899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 3e2bdc73390a43ff9eccc57948e2b4a6 Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {"volumeAttachment": {"volumeId": "0c9a4aea-2ef2-4c27-bf97-ca1f2f192263"}} Sep 09 06:31:18.941426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Cannot 'attach_volume' instance 1dd598c3-8746-4655-aac0-948a7964ac0f while it is in vm_state rescued Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'server_id': '1dd598c3-8746-4655-aac0-948a7964ac0f', 'body': {'volumeAttachment': {'volumeId': '0c9a4aea-2ef2-4c27-bf97-ca1f2f192263'}}} Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:31:18.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1dd598c3-8746-4655-aac0-948a7964ac0f while it is in vm_state rescued Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:31:18.943721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1dd598c3-8746-4655-aac0-948a7964ac0f while it is in vm_state rescued Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Returning 409 to user: Cannot 'attach_volume' instance 1dd598c3-8746-4655-aac0-948a7964ac0f while it is in vm_state rescued {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-56cfb759-3c47-4849-8ba4-6bb4a6840a17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069993 Sep 09 06:31:18.945008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 129/260] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:31:18 2022] POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 06:31:18.957777 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:18.958273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:18.964733 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.965471 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.966013 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:18.968345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:18.968345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:18.968345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.062778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:19.070435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6d74bcca-5cea-4dae-8508-3395e520a3e4 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/action" status: 202 len: 0 microversion: 2.1 time: 0.118081 Sep 09 06:31:19.071601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 130/261] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:31:18 2022] POST /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:31:19.073015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3e7797d9-c52d-4033-8e9c-832d885b1057 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.229691 Sep 09 06:31:19.073739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 132/262] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:18 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:19.083726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:19.084442 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:19.095184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.095725 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.096167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.097016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.097518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.097953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.257140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:19.269395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e84d7294-3321-40ad-b691-b63e0ba6e184 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1509 microversion: 2.1 time: 0.190136 Sep 09 06:31:19.271452 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 131/263] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:19 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:19.308701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:19.309317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:19.318109 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-628681002", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a1e56b2-5174-4859-ad55-8ae965984c50"}], "security_groups": [{"name": "tempest-securitygroup--378656129"}], "key_name": "tempest-keypair-410572750", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:19.332432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.336081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.336725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.337650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.345166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.355038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.486200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:19.496610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-796af6a9-60f4-4c50-a56d-d69a5986ce91 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1270 microversion: 2.1 time: 0.191631 Sep 09 06:31:19.497341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 133/264] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:19 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:19.586057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] validate_networks() for [('6a1e56b2-5174-4859-ad55-8ae965984c50', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:31:19.911354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:19.912347 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:19.922287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.922784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.923324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:19.924173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:19.924700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:19.925189 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.387401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:20.397115 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:20.398695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:20.399993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f1c1f95a-ffa4-495f-beb7-996e817f89f1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1744 microversion: 2.20 time: 0.492604 Sep 09 06:31:20.400828 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 134/265] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:19 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1744 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:20.424583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:20.425195 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:20.431262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.431866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.432370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.433127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.433680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.434170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.552063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:31:20.552554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:31:20.552937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:31:20.553340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:31:20.553741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:31:20.564271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.564857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.565367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.566328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.569507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.569507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.585981 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:20.589968 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:20.605240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:31:20.607860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:31:20.659808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9ffffd06-9068-4fb4-90af-ed7220653f5a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.350359 Sep 09 06:31:20.661153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 132/266] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:31:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:31:20.667579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:20.667579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:20.677258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.677818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.678669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.679510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.680128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.681117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.735773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:20.744636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-24f5414e-baab-42d9-95ba-f78fb70cc53a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.324689 Sep 09 06:31:20.745709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 135/267] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:20 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:20.751462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:20.752212 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:20.759367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.760206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.766448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:20.767756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:20.768465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:20.771164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.146024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.153766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-40e20a84-54b5-45af-8c0e-c1b78806982b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1276 microversion: 2.1 time: 0.406523 Sep 09 06:31:21.155356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 136/268] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:20 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1276 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:21.160320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:21.161095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:21.182979 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.183837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.184442 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.185313 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.186546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.191498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.317859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.328562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8d31df10-a786-4455-baff-7e50ed0412c3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1244 microversion: 2.1 time: 0.171229 Sep 09 06:31:21.329746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 137/269] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:21 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1244 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:21.386230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.396538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-48c597ef-d2fd-441d-b046-bc91faa5b5ad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1509 microversion: 2.1 time: 0.734751 Sep 09 06:31:21.397125 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 133/270] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:20 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1509 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:21.430835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:21.432344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:21.442899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.443706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.444884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.445919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.448046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.448766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.693303 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.702353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.706377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.707239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e1eb6b08-eaed-4b78-af19-abd58f645791 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1744 microversion: 2.20 time: 0.283713 Sep 09 06:31:21.707916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 138/271] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:21 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1744 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:21.773368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:21.773984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:21.783408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.783408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.783408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.783408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:21.784055 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:21.784389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:21.925950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:21.933762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4e6d0286-319c-4c9b-8d40-566837b2f0b7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.164216 Sep 09 06:31:21.934326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 134/272] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:21 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:22.179655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:22.180267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:22.186884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.187368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.187853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.188668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.189457 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.189584 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.333108 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.341037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ae381fd8-ead2-4ae3-90c1-f32cf03b381e tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.166282 Sep 09 06:31:22.341620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 139/273] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:22 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:22.352725 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:22.353631 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:22.360631 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.361052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.361476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.362165 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.362614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.363031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.422202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:22.422999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:22.427781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.429506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.430174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.430602 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.431489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.432131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.432547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.440861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-03449140-d529-4481-b24c-2b91f09e8da9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1292 microversion: 2.1 time: 0.093004 Sep 09 06:31:22.441488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 135/274] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:22 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:22.591476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.601054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9ad5ae2b-6f31-4c29-a66e-1727f1e8de67 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1509 microversion: 2.1 time: 0.184335 Sep 09 06:31:22.601624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 140/275] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:22 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:22.736209 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:22.736812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:22.742700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.743183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.743648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.744414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.744919 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.745343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.880072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.888207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.890410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:22.891593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9034f4c5-fd3b-4b9d-80e0-c54e28fbd80e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1744 microversion: 2.20 time: 0.159915 Sep 09 06:31:22.892147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 136/276] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:22 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:22.957310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:22.957915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:22.963958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.964436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.964860 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:22.965539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:22.965987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:22.966404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.162404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:23.173465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0bdac19d-c811-4c68-970e-79fca914d294 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.219697 Sep 09 06:31:23.174446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 141/277] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:22 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:23.366716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:23.368894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:23.383414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.384028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.384457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.385378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.385892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.387007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.426719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "name": "network-vif-plugged", "status": "completed", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:23.442957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.443795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.445735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.459730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] Creating event network-vif-plugged:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:31:23.465746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-2378ec59-2b6b-4b61-98da-164ad8c2aa1e req-963d704f-b7e7-4233-8473-53d71ad247ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046094 Sep 09 06:31:23.466433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 142/278] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:23.473346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:23.474522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:23.482535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.483705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.484216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.484947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.485366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.485951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.612078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:23.626600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-40b0e2b8-94ce-4155-bcaf-2f1e879880c4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1292 microversion: 2.1 time: 0.157343 Sep 09 06:31:23.627287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 143/279] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:23 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:23.649448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:23.651568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:23.658725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.658909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.659345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.660544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.661080 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.662017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.682683 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:23.693174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2a3e5c55-71a3-4760-8ae2-3ba8f318dc09 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.330917 Sep 09 06:31:23.703510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:23 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:23.925654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:23.926331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:23.933033 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.933527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.934244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:23.935151 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:23.935897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:23.936414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.047312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.059724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3fea9e79-0d4e-4861-afc8-474790971bff tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1509 microversion: 2.1 time: 0.418684 Sep 09 06:31:24.060863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 144/281] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:23 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:24.208789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:24.210198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:24.215516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.219410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.220321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.221087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.222189 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.222992 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.224320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.232313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.237528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.239706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ddeed927-b857-48a9-a0fe-90c8bd203a19 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.325663 Sep 09 06:31:24.241650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 138/282] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:23 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:24.545174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2e4b142-0395-4891-b700-e87c3628fa1f", "tag": "d09eea98-ba89-41b9-a4b1-5d95810e5290"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:24.564219 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.564961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.565596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.594290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] Creating event network-changed:d09eea98-ba89-41b9-a4b1-5d95810e5290 for instance a2e4b142-0395-4891-b700-e87c3628fa1f on hv-cinder-85220 Sep 09 06:31:24.603891 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-7f0f4432-3c8d-42eb-8131-5f279875380e req-c5d935fc-979a-425f-a35b-57d14f6165df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062549 Sep 09 06:31:24.605189 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 139/283] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:24.655202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:24.657381 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:24.665689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.666281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.670507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.671402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.672091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.672705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.682382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.691383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-722a510d-1223-4cf2-9022-36a79e0ae171 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.491405 Sep 09 06:31:24.692105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 145/284] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:24 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:24.739118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:24.739769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:24.745977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.746473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.746910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.747626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:24.748325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:24.748751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:24.757299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:24.766745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-43760ec7-0a83-4979-9211-4e8374ad0fea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1298 microversion: 2.1 time: 0.117259 Sep 09 06:31:24.767596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 140/285] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:24 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:25.085359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:25.086113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:25.093205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.093723 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.094074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.094752 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.095213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.095662 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.100157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:25.112490 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d8167002-779d-4a51-8870-699c8a8e1e4a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.377658 Sep 09 06:31:25.133748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 146/286] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:24 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:25.265579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:25.269085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:25.269085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:25.275958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.276464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.276900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.277767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.278247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.278868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.281643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9183489b-a243-432d-a7b4-30344a752fc0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1515 microversion: 2.1 time: 0.200075 Sep 09 06:31:25.282418 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 141/287] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:25 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:25.503094 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be567a31-4455-4dc6-8be1-937ae81a8dbb", "name": "network-vif-plugged", "status": "completed", "tag": "1b544ee4-2fba-476c-b109-803fa6e71594"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:25.521372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.523486 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.524860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.554015 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] Creating event network-vif-plugged:1b544ee4-2fba-476c-b109-803fa6e71594 for instance be567a31-4455-4dc6-8be1-937ae81a8dbb on hv-cinder-85220 Sep 09 06:31:25.566408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-a03b5e84-7f05-4ef8-b906-cb8d943a1c83 req-1ed35682-e19e-478c-af2f-cd1ff63e6a99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067029 Sep 09 06:31:25.571147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 142/288] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:25.664216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:25.682833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:25.690713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:25.692564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3e213a37-37e7-419d-ad03-b2f4ce46e6a4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.430072 Sep 09 06:31:25.693369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 147/289] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:25 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:25.717856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:25.718760 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:25.742750 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.744993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.745684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.746699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.751017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.751838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.821370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:25.822432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:25.830681 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.831239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.844945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.845655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:25.846141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:25.848410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:25.849463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:26.170628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:26.186040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3cce0aa1-ec70-48c3-a3e3-e0933e041248 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1298 microversion: 2.1 time: 0.370708 Sep 09 06:31:26.200592 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 148/290] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:25 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1298 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:26.213684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:26.228005 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.229188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.229918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.262541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:26.275072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ac932c51-785b-4b0f-bc22-2519402a3132 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.560939 Sep 09 06:31:26.276125 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 143/291] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:25 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:26.279686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:26.285623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:26.286744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:26.300708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.302152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.302840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.304207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.308116 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.309256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.340133 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:26.342925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Going to try to stop instance {{(pid=120795) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 06:31:26.425564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-686108d2-f36b-4492-b8fc-8eacd9ae8627 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action" status: 202 len: 0 microversion: 2.1 time: 0.221394 Sep 09 06:31:26.427599 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 149/292] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:31:26 2022] POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:31:26.438894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:26.440379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:26.460132 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.465764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.473556 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.475043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.476598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.477484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.823190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:26.842726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d8703ca5-5ac9-46cc-aa73-3be636b4e005 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.560719 Sep 09 06:31:26.843475 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 144/293] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:26 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:26.853010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:26.853625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:26.864243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.864782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.865904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.867135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:26.867675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:26.868114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:26.870081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:26.880604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9df4b7fe-f386-4092-9a66-4a06e0c6614d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.447723 Sep 09 06:31:26.888144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 150/294] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:26 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:26.928736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-084cdcfe-3493-47e9-bd5c-644f29981e64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: .version_select at 0x7f74ad135c10>, body: {"keypair": {"name": "tempest-keypair-1568418446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuKlMPv1fuV6R455iiwQbJQYv7iZXBGHghiJK6Og/vi4zVeFB2H1brAfPGDWrRyFslb+It8d/EyXzfQb85p8Hw/uZVkl3AuKt++m26FGd3rlD2cXpitf9dFHp7bSWUjBA=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:26.955409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-084cdcfe-3493-47e9-bd5c-644f29981e64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:26.968884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-084cdcfe-3493-47e9-bd5c-644f29981e64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for user 3e2bdc73390a43ff9eccc57948e2b4a6 and project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:27.018098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-084cdcfe-3493-47e9-bd5c-644f29981e64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092968 Sep 09 06:31:27.021576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 151/295] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:31:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:27.219360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:27.221026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:27.228448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.228857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.229292 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:27.229999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.230454 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.230886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:27.568190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:27.581415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:27.587817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:27.589291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7d4ec6e9-a82a-4632-96b4-1d2c3f656ec8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.744498 Sep 09 06:31:27.589848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 145/296] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:26 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:27.606788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:27.607889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:27.620877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.621381 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.621821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:27.624204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.628555 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.629867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:27.639296 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:27.651161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9780d543-1cf0-4a78-bae0-c6aada6c7b2a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.436242 Sep 09 06:31:27.652030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 152/297] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:27 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:27.866641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:27.867391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:27.879764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.879764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.880436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:27.882531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:27.885186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:27.888539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.085411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:28.109929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a85d37c8-79fa-4c98-b5f8-ea7daf5f2e15 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1266 microversion: 2.1 time: 0.517218 Sep 09 06:31:28.138187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 146/298] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:27 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1266 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:28.183501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:28.184245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:28.217503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.219411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.220211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.221212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.221782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.222276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.373542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:28.383404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bbc73bde-d635-4983-81fa-f9ab8b837a05 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.520549 Sep 09 06:31:28.403574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 153/299] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:27 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:28.512630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:28.525226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c76849b1-426d-496f-8df8-39058114807e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.384768 Sep 09 06:31:28.526085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:28 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:28.619918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:28.620530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:28.627998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:28.629731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.630452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.631202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.632219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.632905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.633544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.682943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:28.684295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:28.692781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.696227 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.702792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:28.704026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:28.704885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:28.705664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:29.233859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.252889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.254564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.256321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5ec2da3d-2e8d-439b-8078-211d09cb9f05 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.640254 Sep 09 06:31:29.256923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 154/301] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:28 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:29.261841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:29.268144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:29.278459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:29.281112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:29.285852 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.290330 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:29.296436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:29.300877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:29.301628 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0ba90e48-2a49-40ae-b80b-6c7364255f07 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.615914 Sep 09 06:31:29.302260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 148/302] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:28 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:29.312003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:29.340678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1242505152", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98282524-73a1-460b-a31c-3ff4ef655afa"}], "security_groups": [{"name": "tempest-securitygroup--1496013381"}], "key_name": "tempest-keypair-1568418446", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:29.552543 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] validate_networks() for [('98282524-73a1-460b-a31c-3ff4ef655afa', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:31:29.640213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.650970 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a8ade086-b8ea-4be1-85df-103e4223aac1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1454 microversion: 2.1 time: 0.392821 Sep 09 06:31:29.656390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 155/303] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:29 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1454 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:29.662165 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:29.662978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:29.669760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:29.670468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:29.671060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:29.671955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:29.672562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:29.675880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:29.978484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:29.989284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-50f66393-443d-4826-8a1c-86c6e5795beb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.331157 Sep 09 06:31:30.004397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 156/304] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:29 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:30.014957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:30.015972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:30.023896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.025295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.026423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.028059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.033075 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.033752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.293752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:30.310568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-327bf899-9953-428b-b88c-6767eb6d4a86 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.304401 Sep 09 06:31:30.311628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 157/305] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:30 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:30.316206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:30.317072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:30.322228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:31:30.322228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:31:30.323219 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:31:30.323823 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:31:30.324596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:31:30.327562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.328671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.329283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.330154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.330764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.331339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.337289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.338270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.339799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.340817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.342516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.366796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:31:30.372229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Getting quotas for user 3e2bdc73390a43ff9eccc57948e2b4a6 and project 9fae936c35c54adfaf8cb0df7f4ca9dd. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:31:30.384787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:31:30.387448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:31:30.448742 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6e55f29c-3398-4e20-a4e6-29070de06850 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.115309 Sep 09 06:31:30.456383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 149/306] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:31:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:31:30.480669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af89a0ac-56b7-4efa-aa9b-69e8c6b358c2", "tag": "d57c2843-153e-4f69-85d4-96c12063b672"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:30.497414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.498327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.498783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.512529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] Creating event network-changed:d57c2843-153e-4f69-85d4-96c12063b672 for instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 on hv-cinder-85220 Sep 09 06:31:30.519230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-860a0dd0-bdc0-42e4-ac2d-42bb2084e328 req-bacaa3d6-60af-4139-8736-3385cdd04e8f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061392 Sep 09 06:31:30.520149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 150/307] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:30.528920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:30.529951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:30.532832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:30.537659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.538625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.539237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.540347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.540966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.541197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-53f98697-f5e3-48be-b3ff-2db7e708a68a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1454 microversion: 2.1 time: 0.228760 Sep 09 06:31:30.541774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 158/308] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:30 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1454 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:30.542022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.555502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:30.556375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:30.581006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.581632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.582443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.583923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:30.584550 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:30.585129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:30.975006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:30.986652 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-45cce581-8251-4fda-886e-218c7a10f7b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.433280 Sep 09 06:31:31.006512 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 159/309] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:30 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:31.013021 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d8b906e7-4148-426e-a863-6c23b29f2c56 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:31.018514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d8b906e7-4148-426e-a863-6c23b29f2c56 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:31.143647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d8b906e7-4148-426e-a863-6c23b29f2c56 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.152464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.153480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d8b906e7-4148-426e-a863-6c23b29f2c56 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1246 microversion: 2.1 time: 0.144028 Sep 09 06:31:31.154243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 160/310] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:31 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:31.161359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.170841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:31.172992 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.177070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6e1c5ce4-1921-4e30-aac9-eeeef8e8a730 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.655080 Sep 09 06:31:31.177778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 151/311] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:30 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:31.192621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:31.206155 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:31.207319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:31.207792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:31.208508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:31.211314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:31.212894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:31.336797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:31.337580 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:31.350415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:31.351309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:31.352000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:31.352935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:31.353626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:31.356066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:31.675044 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.686639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0f1740b9-e5df-47e4-b713-ea059e48d4d6 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.522589 Sep 09 06:31:31.687209 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 161/312] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:31 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:31.770376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:31.780849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-72b24959-53d8-412a-8e69-6208cd08f33b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.447758 Sep 09 06:31:31.781636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 152/313] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:31 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:32.013868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:32.015940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:32.026603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.027346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.028453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.029914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.030594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.031247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.176801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:32.177567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:32.184824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.188104 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.188858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.192802 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.193996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.196233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.386926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:32.398762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-41182318-80ba-4bfb-b5ea-199795601766 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1298 microversion: 2.1 time: 0.225710 Sep 09 06:31:32.416105 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 153/314] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:32 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1298 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:32.430779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:32.434562 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:32.448326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.449223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.450257 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.452028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.452712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.453353 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.622982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:32.632058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5f07891d-0e25-4436-952a-562300bc5f37 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.622143 Sep 09 06:31:32.646508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 162/315] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:32 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:32.720133 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:32.720806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:32.739448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.743893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.744406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.745168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.745642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.746069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.804566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:32.818600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:32.820445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:32.822052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9603fc8c-f629-4a99-9b93-0642a46f8f6c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.404466 Sep 09 06:31:32.845545 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 154/316] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:32 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:32.860441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:32.867045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:32.879461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.880412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.880855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:32.881638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:32.882217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:32.884665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.069812 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:33.085279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0b1981c9-0478-4310-838a-e845b8ecc7fc tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.368836 Sep 09 06:31:33.102174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 163/317] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:32 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:33.116070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:33.127164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-380f2b84-1922-44ef-ab74-bedf1ee2385a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.273613 Sep 09 06:31:33.140101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 155/318] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:32 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:33.430445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:33.431174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:33.472549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.477351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.481039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.487615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.488261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.488832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.613880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:33.624266 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4aade8a2-8018-499f-9566-039b4cd0c94f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1306 microversion: 2.1 time: 0.197741 Sep 09 06:31:33.625228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 164/319] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:33 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:33.673264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:33.674520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:33.681697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.682430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.683022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.684186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.686314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.687286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.738724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be567a31-4455-4dc6-8be1-937ae81a8dbb", "tag": "1b544ee4-2fba-476c-b109-803fa6e71594"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:33.750336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.750979 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.751619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.764489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] Creating event network-changed:1b544ee4-2fba-476c-b109-803fa6e71594 for instance be567a31-4455-4dc6-8be1-937ae81a8dbb on hv-cinder-85220 Sep 09 06:31:33.770722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-918109ba-a132-42d9-9381-87ab7548a854 req-78a96693-1270-4bf2-8f3b-9252fdacad07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036590 Sep 09 06:31:33.780503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 165/320] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:33.854076 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:33.854858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:33.865927 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.868045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.869327 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.871085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:33.872221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:33.873708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:33.931272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:33.942658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-80406cd5-86a6-42e2-85f0-8258a4979b71 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.274386 Sep 09 06:31:33.943766 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 156/321] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:33 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:34.108583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.118750 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:34.119807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:34.124834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.125389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.126754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-267e6e42-b7bb-42e8-ad32-de903223ae21 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.278074 Sep 09 06:31:34.127744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 166/322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:33 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:34.128620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.129414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.130013 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.130866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.131469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.132148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.161294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:34.162131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:34.176453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.178522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.179092 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.180202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.181693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.185348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.233817 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:34.450803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.461266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8a14f5c1-fce4-45e0-9d37-356e3f7c495c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.350703 Sep 09 06:31:34.461507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.465505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 157/323] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:34 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:34.470273 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5a0b6de5-7dbc-44ec-a0f1-f14c812104ba tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.316415 Sep 09 06:31:34.470849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 167/324] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:34 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:34.650652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:34.651698 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:34.658498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.659286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.659992 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.660950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.661520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.662187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.739686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:34.748714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-50b451cf-9243-4266-823b-0bb677d3e859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1306 microversion: 2.1 time: 0.101782 Sep 09 06:31:34.749337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 158/325] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:34 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:34.970942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:34.971580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:34.980392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.981001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.981439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:34.982769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:34.983337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:34.983792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.158626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:35.160453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:35.169256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.170455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.171016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.171909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.172515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.172942 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.177340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:35.189192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-052e3206-c684-4be6-a8c7-fcd3e087edee tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.222560 Sep 09 06:31:35.191857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 168/326] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:34 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:35.339383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:35.348909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:35.352349 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:35.354646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0ed9b42b-ab97-463b-ad7d-b7a9f7272460 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.203880 Sep 09 06:31:35.362975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 159/327] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:35 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:35.494000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:35.497078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:35.498476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:35.500670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:35.510684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.511194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.511660 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.513348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.514019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.514623 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.515628 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.516101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.516529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.519134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:35.519653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:35.520093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:35.991134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.004035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.008545 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d6989341-8361-44ba-965e-51edbb287978 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.521069 Sep 09 06:31:36.010774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 169/328] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:35 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:36.013494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c137f97e-1233-4d81-8bc3-56888d27bdd3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.523252 Sep 09 06:31:36.017781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:36.018728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:36.031502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.032629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.033326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.034847 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 160/329] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:35 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:36.036180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.036957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.037404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.130606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.142088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5f1a82e2-f501-4f49-90ee-34af69ca7fd3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1306 microversion: 2.1 time: 0.129835 Sep 09 06:31:36.142742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 170/330] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:36 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:36.213988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:36.214703 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:36.221673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.222264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.222766 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.223575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.224439 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.224924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.384959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:36.385771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:36.394864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.395291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.395750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.396638 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:36.397166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:36.397589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:36.398581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.408148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d71512e3-d908-4930-91e2-07f47d241f8b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.198019 Sep 09 06:31:36.408724 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 161/331] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:36 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:36.541374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.551229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.553328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:36.554607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c8050b10-9ffd-4800-ae15-6a230e1d12d2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.175951 Sep 09 06:31:36.555165 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 171/332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:36 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:37.033962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:37.036347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:37.045217 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:37.045936 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:37.046505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:37.048414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.052221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.053666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.054169 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.054285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.054610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.055319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.055811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.056237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.058153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.060126 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.061777 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.112766 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:37.428220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.437723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4132191e-314d-4f8d-bff7-ab86b383d2e0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.398222 Sep 09 06:31:37.439129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 172/333] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:37 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:37.443819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:37.444420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:37.452110 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.452600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.453225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.453920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.454393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.454803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.509130 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.517900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ef19fc35-0ae5-4f6c-9574-f1731454b4e9 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.487753 Sep 09 06:31:37.518474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 162/334] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:37 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:37.536395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:37.537155 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:37.545884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.550325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.552718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.553542 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.554916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.556232 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f1523d5e-31c6-4825-9645-19f532b94942 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1304 microversion: 2.1 time: 0.115795 Sep 09 06:31:37.561278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 173/335] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:37 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:37.561521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.562098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.585480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:37.586214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:37.594031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.595528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.597000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.599661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:37.600772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:37.601208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:37.889002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.897000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-920cecf6-bfcb-4412-b0a9-c00975b42f51 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.377073 Sep 09 06:31:37.897571 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 163/336] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:37 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:37.917934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.927054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.928549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:37.929744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-232facd1-e531-4259-9554-cb42cde79327 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1739 microversion: 2.20 time: 0.348197 Sep 09 06:31:37.930301 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 174/337] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:37 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1739 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:38.462296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:38.462964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:38.469688 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:38.470192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:38.470633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:38.471343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:38.471886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:38.472315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:38.541067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:38.541688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:38.550531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:38.551033 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:38.551472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:38.552499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:38.553142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:38.553541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:38.988598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:38.999113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-34a8036f-c617-4dc0-b0f6-65934e46b65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.540647 Sep 09 06:31:39.000357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 164/338] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:38 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:39.005505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:39.006374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:39.012917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.014644 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.015322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.016436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.017238 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.018030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.052744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:39.062079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f4716f11-c4d0-4be2-a209-b0995c1f5b2c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.524883 Sep 09 06:31:39.063255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 175/339] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:38 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:39.067984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:39.068767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:39.078565 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.079299 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.079940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.080819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.081453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.082036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.751237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:39.759800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b8c356d4-4f3f-43a6-8321-5a658c545859 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.758088 Sep 09 06:31:39.763449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 165/340] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:39 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:39.765225 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e4b142-0395-4891-b700-e87c3628fa1f", "name": "network-vif-plugged", "status": "completed", "tag": "d09eea98-ba89-41b9-a4b1-5d95810e5290"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:39.776433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.776930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.777364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.780989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:39.789845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-72c5e308-dbf5-4da3-8fd4-ff7eeb0362fe tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.725366 Sep 09 06:31:39.790457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] Creating event network-vif-plugged:d09eea98-ba89-41b9-a4b1-5d95810e5290 for instance a2e4b142-0395-4891-b700-e87c3628fa1f on hv-cinder-85220 Sep 09 06:31:39.790607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 176/341] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:39 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:39.796566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:39.797253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:39.803700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.804324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.804830 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.805769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:39.806302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:39.806917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:39.810558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-73be5b2e-6287-49ad-9731-8ec90521331a req-155ab7b1-e24c-4a9e-95f0-f7bcbf36b0d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048129 Sep 09 06:31:39.811456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 166/342] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:40.025231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:40.025935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:40.033969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.034505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.034911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.035644 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.036582 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.036715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.235429 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:40.243852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:40.245662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:40.246823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-09d04b79-ee06-4f67-b0a3-3c4351fef443 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1721 microversion: 2.20 time: 0.455299 Sep 09 06:31:40.248219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 177/343] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:39 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1721 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:40.253029 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:40.254128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:40.260595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.261080 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.261691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.262381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.262834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.263416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.350597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:40.371030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:40.379527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8578eb66-cb26-4e32-9ca2-0d6e057272f9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.358539 Sep 09 06:31:40.380024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 167/344] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:40 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:40.477586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:40.487376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-66f1779a-cf34-41dd-a4c9-bc68f58b877f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.237875 Sep 09 06:31:40.487991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 178/345] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:40 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:40.531738 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:40.536584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=12 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:40.541939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.542521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.542963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.555938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] Creating event network-changed:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:31:40.561013 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-d5e1b916-838f-4d74-a127-511a1a3cb8f3 req-7ecc8b1c-d4e1-48f1-b1f4-15182997f26d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Sep 09 06:31:40.561617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 168/346] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:40.787011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:40.788308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:40.794619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.795373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.796172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.797220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.798085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.798816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.814873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:40.816484 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:40.822934 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.823704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.824492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:40.826070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:40.826808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:40.827395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.038853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.047720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c230a552-4d09-4e57-bb4f-a87fa28cc53e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.264728 Sep 09 06:31:41.048318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 179/347] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:40 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:41.051838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.068682 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8b56fce7-5aff-4614-8f51-03ed22334b67 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.257816 Sep 09 06:31:41.069547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 169/348] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:40 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:41.273068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:41.273708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:41.275629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=18 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:41.281509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.282006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.282444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.283149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.283642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.284072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.402264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:41.402903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:41.408982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.409536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.410159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.411078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.411773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.412323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.417618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.428217 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.429825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.431025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b636e3df-1c9b-4acb-96b7-62ba26246cfd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1721 microversion: 2.20 time: 0.161901 Sep 09 06:31:41.431978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 180/349] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:41 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:41.511258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:41.511915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:41.518504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.519022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.519456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.520187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.520645 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.521073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.559361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.569115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0caef6e3-fc8a-4448-bab0-c62f967578f0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.170635 Sep 09 06:31:41.569797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 170/350] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:41 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:41.661538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:41.669719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8ba575e9-333d-4a69-81e6-0fba06d24ef4 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.161713 Sep 09 06:31:41.670282 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 181/351] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:41 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:41.827158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89a0ac-56b7-4efa-aa9b-69e8c6b358c2", "name": "network-vif-plugged", "status": "completed", "tag": "d57c2843-153e-4f69-85d4-96c12063b672"}, {"server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "name": "network-vif-unplugged", "status": "completed", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:41.838999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:41.839476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:41.839936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:41.854966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Creating event network-vif-plugged:d57c2843-153e-4f69-85d4-96c12063b672 for instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 on hv-cinder-85220 Sep 09 06:31:41.855472 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] Creating event network-vif-unplugged:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:31:41.862387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-44bcd3df-bf2b-4ae0-94ae-9a5500db0800 req-66f007bd-ca8d-4533-87f3-9554bf9943e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039277 Sep 09 06:31:41.862965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 171/352] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:42.072804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:42.073336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:42.080041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.080531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.080965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.081655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.082116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.082540 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.093635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:42.094341 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:42.100665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.101153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.101590 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.102278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.102741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.103170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.290775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.296255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.298716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-dd21d303-5033-41e7-9c45-1fe065c8aca9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.229817 Sep 09 06:31:42.299407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 182/353] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:42 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:42.303873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4a768eea-d4e8-403d-808c-2de67a7fd1c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.215081 Sep 09 06:31:42.304529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 172/354] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:42 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:42.457533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:42.458166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:42.464082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.464570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.465004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.465728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.466175 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.466599 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.595134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:42.595771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:42.602062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.602806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.603850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.604197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.604661 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.605087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.619497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.628435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.629890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.631055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5b11a9b5-03fa-464c-b9ba-0f6f0f090108 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1721 microversion: 2.20 time: 0.177421 Sep 09 06:31:42.631634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 183/355] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:42 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:42.694338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:42.694957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:42.701848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.702341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.702774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.703475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:42.703978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:42.704402 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:42.708874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:42.741854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.750560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-381c1c26-4b3a-417d-acd2-badc14643e6e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.159792 Sep 09 06:31:42.751254 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 173/356] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:42 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:42.838605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:42.846738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a1f3320b-4d28-45bf-84d0-d5a9d63a5128 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.156345 Sep 09 06:31:42.847325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 184/357] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:42 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:43.321523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:43.322135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:43.328507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:43.329126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:43.329372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.329868 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.330306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.331010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.331470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.332000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.335435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.335955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.336390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.337081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.337541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.337966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.529409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.534651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.538236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2a06bad7-e5ca-4992-9b64-915c8fd5ebaf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.220526 Sep 09 06:31:43.538818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 174/358] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:43 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:43.542810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3442a182-ffe4-408b-93fb-bbb7b9a037aa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.218646 Sep 09 06:31:43.543577 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 185/359] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:43 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:43.662732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:43.663359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:43.669380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.669869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.670319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.671045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.671508 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.671961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.773912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:43.774529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:43.781126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.781558 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.781995 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.782694 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.783157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.783610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.800933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.808842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.810293 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.811523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-123c3e6c-57ff-4240-9824-d49668b1af4c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1721 microversion: 2.20 time: 0.152716 Sep 09 06:31:43.812107 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 175/360] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:43 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:43.872438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:43.873058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:43.879357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.879891 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.880336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.881075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:43.881537 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:43.881962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:43.921826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:43.930475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2f001122-de44-4b44-9ca9-373927b67f2a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.160275 Sep 09 06:31:43.931078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 186/361] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:43 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:44.016523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.024171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1f30135c-fae9-47a5-be93-bbd8d700ff2f tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.155585 Sep 09 06:31:44.024739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 176/362] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:43 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:44.563880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:44.565011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:44.566769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:44.567389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:44.571116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.571631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.572065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.572760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.573213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.573628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.573895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.574397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.574829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.575531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.576028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.576480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.773737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.777436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.782629 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5acb373a-f455-42a5-8866-6a211c427965 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.219738 Sep 09 06:31:44.783301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 177/363] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:44 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:44.786780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d6c1c0ba-cdf2-4a90-b19b-a9760585a346 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.227646 Sep 09 06:31:44.787333 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 187/364] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:44 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:44.837342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:44.837881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:44.844613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.845101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.845540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.846230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.846695 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.847125 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.954849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:44.955466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:44.962378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.962864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.963297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.964023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:44.964487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:44.964912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:44.980474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.989408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.990971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:44.992266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c082af6f-f11b-4b53-bdbb-1659d7c813e1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1721 microversion: 2.20 time: 0.158888 Sep 09 06:31:44.992904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 178/365] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:44 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:45.046470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:45.047089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:45.063689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.064177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.064617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:45.065325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.065790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.066216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:45.196766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:45.208083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-43490401-1126-4890-a42d-4f4dea5a1f21 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.257691 Sep 09 06:31:45.208672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 188/366] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:44 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:45.259702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:45.268394 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3e2628a4-8c22-4bd7-8bb6-70cb556940ca tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.225798 Sep 09 06:31:45.268952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 179/367] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:45 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:45.804959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:45.805795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:45.811391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:45.812307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:45.813121 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.813845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.814472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:45.815379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.816048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.816659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:45.819661 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.820367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.820862 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:45.821714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:45.822322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:45.823044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.131420 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.138170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.139065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-09bf26f8-b812-4f66-a768-2dfe3a3557bd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.332652 Sep 09 06:31:46.139777 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 180/368] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:45 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:46.144363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:46.144991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:46.145954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-408f90a6-d2ff-4e91-8ed6-31506a1dfef0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.344905 Sep 09 06:31:46.146820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 189/369] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:45 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:46.150788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.151280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.151751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.152443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.152903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.153374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.157780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:46.232088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:46.233299 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:46.239475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.240068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.240508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.241208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.241669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.242097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.297737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.305798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.307318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.308574 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ef987156-9894-4543-bcc9-58c01aa769bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1724 microversion: 2.20 time: 0.167892 Sep 09 06:31:46.309224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 181/370] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:46 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:46.314138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:46.314746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:46.320437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.320918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.321558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.322249 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.322704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.323121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.413311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.422349 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d04faff6-627e-4d3e-b0c5-c3a9ace850cd tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.194211 Sep 09 06:31:46.422915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 190/371] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:46 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:46.427597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c87aa82-151a-4201-a0b2-22eb642159c8"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:46.429987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:46.436091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.436579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.437840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.437840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.438440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.438741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.479405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:46.487791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7fcae1ce-6068-46bf-83b7-94aad331714d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1318 microversion: 2.1 time: 0.177482 Sep 09 06:31:46.488271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 182/372] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:46 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:46.743598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2b8488fb-d9b3-4cfb-8f37-a41a1a27655a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319525 Sep 09 06:31:46.744141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 191/373] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Sep 9 06:31:46 2022] POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:31:46.873585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:46.874414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:46.880964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.881464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.881903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.882610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:46.883070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:46.883578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:46.936323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120797) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 06:31:47.008935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b73e297d-d7de-4858-a555-0d2106ada816 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/action" status: 202 len: 0 microversion: 2.20 time: 0.139395 Sep 09 06:31:47.009624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 183/374] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 9 06:31:46 2022] POST /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:31:47.018634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:47.019398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:47.026509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.027015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.027458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.028189 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.028823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.029257 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.162269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:47.163328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:47.168455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.172131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.173332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.173966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.174947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.175615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.176228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.177797 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.179278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.180508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b26a7427-6b14-4287-9caf-e038178a87e0 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1810 microversion: 2.20 time: 0.166715 Sep 09 06:31:47.181066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 192/375] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:47 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:47.186985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:47.187878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:47.194234 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.194953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.195595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.196493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.197129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.197727 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.377317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.385474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fc9ad398-0dd9-4099-9ec1-413b4f8534ae tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.227434 Sep 09 06:31:47.386035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 184/376] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:47 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:47.406862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.414603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ebc807c7-89a0-416f-958c-e460ab08f379 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1365 microversion: 2.1 time: 0.232413 Sep 09 06:31:47.415391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 193/377] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:47 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:47.446568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:47.447386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:47.454443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.455089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.455533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.456255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.456718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.457168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.573523 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:47.574410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:47.582453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.583619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.584291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.585149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:47.585708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:47.593573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:47.733893 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.747372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f486ebf0-26ca-4c21-a0c7-0a5bda374e38 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1725 microversion: 2.1 time: 0.304897 Sep 09 06:31:47.791570 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 185/378] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:47 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:47.840737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:47.850171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c906c70e-b748-4ce4-869b-7941e87d2f59 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1506 microversion: 2.1 time: 0.281389 Sep 09 06:31:47.863984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 194/379] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:47 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:48.208015 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:48.208626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:48.216053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.219252 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.232455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.234119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.234720 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.235160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.404247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:48.409438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:48.410055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:48.413849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:48.415273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:48.416455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e002bafc-9304-4ff2-9d1f-7332c97899d5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1810 microversion: 2.20 time: 0.212584 Sep 09 06:31:48.416570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.417230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 186/380] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:48 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:48.417361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.417452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.418338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.418799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.419224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.437404 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:48.438183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:48.444333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.444826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.445259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.445961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.446422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.446849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.622610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:48.631717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-50f15380-a233-4018-9bf3-14e5546142c3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.226706 Sep 09 06:31:48.632543 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 195/381] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:48 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:48.638962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:48.650792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-868faf4c-978e-4789-b16d-382ce55f163c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1555 microversion: 2.1 time: 0.217222 Sep 09 06:31:48.651310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 187/382] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:48 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:48.676435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:48.676956 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:48.683170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.683726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.684363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.685070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.685537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.686749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.805465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-80e4f93e-d25b-4d9b-bc79-127ce236fb1c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134202 Sep 09 06:31:48.806051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 196/383] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:31:48 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:48.814491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:48.815332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:48.824217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.824651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.825086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:48.826073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:48.827269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:48.832006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.341560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.351783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3799d430-5c2c-41f2-b0b8-955eafd4fd97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1702 microversion: 2.1 time: 0.549995 Sep 09 06:31:49.352667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 188/384] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:48 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1702 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:49.376665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:49.386753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.400137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.400137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.417748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Going to try to start instance {{(pid=120795) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 06:31:49.442188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:49.443295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:49.454488 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:49.457663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.458167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.458779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.459498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.459988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.460410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.483632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-289eeffe-de6d-406e-a90e-3455e918cf3d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action" status: 202 len: 0 microversion: 2.1 time: 0.110519 Sep 09 06:31:49.484813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 197/385] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:31:49 2022] POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:31:49.494022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:49.494735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:49.501811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.502334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.502786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.503653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.504149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.504556 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.687325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.696398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.698128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.698921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.699743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b7320736-4c24-4c66-a4d8-f87c7e532b5f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1752 microversion: 2.20 time: 0.261415 Sep 09 06:31:49.700555 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 189/386] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:49 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1752 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:49.705684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:49.706425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:49.709807 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c80b806d-5503-49c4-a638-9c963d5d5914 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1711 microversion: 2.1 time: 0.221106 Sep 09 06:31:49.711465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 198/387] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:49 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1711 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:49.712794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.713531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.714194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.715126 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:49.715822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:49.716463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:49.861622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:49.870153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e9a1b906-c1e3-452b-96c9-87cf76d98ae2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.167979 Sep 09 06:31:49.870778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 190/388] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:49 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:50.107252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af89a0ac-56b7-4efa-aa9b-69e8c6b358c2", "tag": "d57c2843-153e-4f69-85d4-96c12063b672"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:50.117802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:50.118293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:50.118922 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:50.130595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] Creating event network-changed:d57c2843-153e-4f69-85d4-96c12063b672 for instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 on hv-cinder-85220 Sep 09 06:31:50.136542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-a8a590b6-f94c-49cc-8800-de73951f3325 req-e2c00605-bd3f-4632-8b2f-0118133c62d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033115 Sep 09 06:31:50.137147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 199/389] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:50.729810 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:50.739569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:50.740757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:50.745118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:50.761307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:50.764093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:50.765583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:50.768373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:50.769080 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:50.770244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:50.771522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:50.771899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:50.772480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:50.773002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:50.773568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:50.776976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:51.359482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:51.370168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:51.384662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-76a2cbfb-7d5f-4ccb-b76f-397c0f5989e9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1711 microversion: 2.1 time: 0.650521 Sep 09 06:31:51.385574 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:51.387262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:51.387812 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 200/390] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:50 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1711 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:51.402586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0e24821c-2852-41d3-9994-cca39d6ec6c7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1752 microversion: 2.20 time: 0.676949 Sep 09 06:31:51.403715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 191/391] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:50 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1752 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:51.415890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:51.415890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:51.419719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:51.420500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:51.422406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:51.423452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:51.424058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:51.424677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:51.719687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:51.729866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4aaa523f-0e25-4816-a33e-f6622867fd5e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.333179 Sep 09 06:31:51.733965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 201/392] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:51 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:52.413131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:52.413912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:52.420015 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.420482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.421149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.421818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.422278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.422878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.449856 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:52.452674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:52.463437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.465055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.466043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.468047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.469251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.470020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.895007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:52.906089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5c6cd6c7-0571-48df-8574-c977dde466ed tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1711 microversion: 2.1 time: 0.496869 Sep 09 06:31:52.906883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 192/393] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:52 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1711 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:52.912205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:52.912957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:52.917878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:52.930335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.930984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.931428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.932168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:52.932645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:52.933069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:52.938330 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:52.944148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:52.945367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2047a1e8-56e9-481a-9f3a-bb0606445e8a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.514453 Sep 09 06:31:52.948017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 202/394] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:52 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:53.138943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "name": "network-vif-plugged", "status": "completed", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:53.148878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:53.153792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:53.156833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:53.157541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:53.157986 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:53.165616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-62b5f2a8-3b38-4e4a-b89c-ee93e2023b5f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.257587 Sep 09 06:31:53.166192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 193/395] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:52 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:53.173890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] Creating event network-vif-plugged:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:31:53.181691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-fcdd1cd0-dd5f-4534-848a-91c1c2deb536 req-9928fb55-7080-41fe-9b46-893fb3e82d31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048735 Sep 09 06:31:53.182362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 203/396] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:31:53.930280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:53.930885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:53.937618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:53.938104 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:53.938537 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:53.939226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:53.939722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:53.940148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:53.972762 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:53.973364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:53.980005 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:53.980486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:53.980914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:53.981602 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:53.982052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:53.982616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:54.138433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:54.147299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0eb78eeb-d6c2-4eaf-b107-8a46a73df75b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1711 microversion: 2.1 time: 0.221060 Sep 09 06:31:54.147917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 194/397] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:53 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1711 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:54.160267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:54.169254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:54.171440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:54.172669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e5bc2f43-698c-4bcb-90ae-841fbf602695 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.204654 Sep 09 06:31:54.173230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 204/398] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:53 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:54.190767 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:54.191375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:54.197479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:54.197963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:54.198401 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:54.199121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:54.199616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:54.200041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:54.339467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:54.347809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3f4e3462-fa15-46b3-b748-d3a50602af98 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.160939 Sep 09 06:31:54.348381 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 195/399] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:54 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:55.170707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:55.171403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:55.178163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.178673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.179107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.179818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.180295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.180719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.198201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:55.198966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:55.205338 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.205850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.206286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.206975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.207434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.207884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.367499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:55.376131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-398f8e50-5df9-4e02-af5c-96d8689232a0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1715 microversion: 2.1 time: 0.209861 Sep 09 06:31:55.376719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 205/400] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:55 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1715 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:55.381255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:55.381810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:55.387674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.388157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.388617 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.389308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:55.389763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:55.390185 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:55.390451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:55.395408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:31:55.399835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:55.401461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:55.402685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-34f0dedf-326f-4a3d-8ce3-d00351475188 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.208369 Sep 09 06:31:55.403317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 196/401] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:55 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:31:55.530683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:55.538142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6fdc2419-5441-4326-8d2e-b655902cb74c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1372 microversion: 2.1 time: 0.160492 Sep 09 06:31:55.538769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 206/402] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:55 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:31:56.429932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:56.430535 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:56.437993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:56.438479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:56.438914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:56.439630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:56.440092 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:56.440515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:56.565706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:56.566414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:56.574041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:56.574614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:56.575047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:56.576403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:56.577098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:56.577961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:56.586387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:56.596149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:56.597618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:56.599266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cb2a0755-c51c-49f9-9719-ca3b0c8d89b4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.173187 Sep 09 06:31:56.599859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 197/403] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:56 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:56.977735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:56.985636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-10c519a7-e2d1-4a4e-83d6-aba8ebeeedd2 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1565 microversion: 2.1 time: 0.424214 Sep 09 06:31:56.986241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 207/404] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:31:56 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1565 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:31:57.008657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:57.009152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:57.015897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:57.016368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:57.016804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:57.017487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:57.017939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:57.018359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:57.105492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fe1bcabd-e557-4f6c-819b-b5741fd9754c tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100749 Sep 09 06:31:57.106094 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 198/405] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:31:57 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:57.625522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:57.626518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:57.633089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:57.633577 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:57.634004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:57.634711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:57.635253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:57.635813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:57.801659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:57.808632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:57.811386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:57.813466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cd12c38e-cf73-480e-8270-b7ef317a4fc1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.191919 Sep 09 06:31:57.814419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 208/406] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:57 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:31:58.188383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:31:58.198252 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:58.198740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:58.199174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:58.210501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] Creating event network-changed:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:31:58.215647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-d18a2c5d-2fb4-4cd8-8143-b09a39dd1fa3 req-f8f43e22-0281-4320-9d90-44b21401b429 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032516 Sep 09 06:31:58.216245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 199/407] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:31:58.855640 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:31:58.856396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:31:58.863721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:58.864311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:58.865074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:58.865800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:31:58.866265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:31:58.866684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:31:59.024398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:59.036277 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:59.037725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:31:59.038935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f39d34fb-b4fb-4cb0-8ff7-0488004979b5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.199136 Sep 09 06:31:59.039478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 209/408] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:31:58 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:32:00.065450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:00.066145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:00.072217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:00.072713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:00.073152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:00.074166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:00.074282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:00.074727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:00.211806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:00.224741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:00.226178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:00.227334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-aa630e8e-796f-4e73-83ca-3f56351f7e44 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.166203 Sep 09 06:32:00.227924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 200/409] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:00 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:01.255375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:01.256020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:01.262441 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:01.262924 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:01.263912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:01.264839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:01.265251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:01.265678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:01.398046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:01.406954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:01.408443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:01.409600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-467f868d-19d7-4357-b81f-6f61700fe672 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.158167 Sep 09 06:32:01.410157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 210/410] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:01 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:02.434226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:02.434854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:02.441801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:02.442305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:02.442763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:02.443414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:02.443900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:02.444319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:02.585866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:02.595527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:02.597043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:02.598197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-86650109-7d3a-41f4-9ad8-2e235ad9daa1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.167902 Sep 09 06:32:02.599012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 201/411] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:02 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:03.625002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:03.625750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:03.632227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:03.632716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:03.633154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:03.633848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:03.634311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:03.634742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:03.765103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:03.773933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:03.775380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:03.776568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7c4f932a-0a39-4d15-9b9c-acbf89eb7d66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155570 Sep 09 06:32:03.777131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 211/412] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:03 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:04.804376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:04.805400 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:04.811655 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:04.812137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:04.812562 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:04.813254 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:04.813742 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:04.814163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:04.951198 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:04.959675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:04.961108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:04.962289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-054f229c-af1f-41d1-af53-e9bdafae4756 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.162091 Sep 09 06:32:04.962847 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 202/413] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:04 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:05.989039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:05.989776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:05.996156 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:05.996643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:05.997130 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:05.997876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:05.998328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:05.998804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:06.135480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:06.144615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:06.146039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:06.147585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7fd7033f-2de4-4563-8688-868be0894064 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.162502 Sep 09 06:32:06.148151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 212/414] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:05 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:07.174982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:07.175815 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:07.177987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:07.183794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:07.184290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:07.184774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:07.185520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:07.185980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:07.186433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:07.327763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:07.345222 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:07.347361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:07.348809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a2a7f821-2ea8-47f5-b382-b925da3324c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.178213 Sep 09 06:32:07.349787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 203/415] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:07 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:08.376861 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:08.378808 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:08.389749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:08.390336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:08.390840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:08.391651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:08.392180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:08.393232 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:08.531317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:08.540573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:08.542084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:08.543258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-331f8a9d-2126-4984-a710-e88dbb0eddec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.171350 Sep 09 06:32:08.544111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 213/416] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:08 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:09.573533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:09.574271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:09.581454 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:09.581942 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:09.582417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:09.583120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:09.583600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:09.584363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:09.724926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:09.733756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:09.735262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:09.736609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-540e050d-2deb-4217-9903-010673340ae1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.170475 Sep 09 06:32:09.737370 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 204/417] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:09 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:10.763771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:10.764411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:10.773144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:10.774064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:10.774627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:10.775718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:10.776322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:10.784198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:10.935097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:10.944340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:10.945815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:10.946964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c557ecae-a701-4c24-b831-191d711d94e8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.187775 Sep 09 06:32:10.947514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 214/418] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:10 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:11.972980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:11.973885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:11.980085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:11.980601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:11.981043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:11.981744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:11.982232 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:11.982662 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:12.132039 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:12.141832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:12.144163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:12.145351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a7bebc0f-ebf9-4c08-a5f9-f503f79bb1d4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.176487 Sep 09 06:32:12.163615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 205/419] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:11 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:13.181039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:13.182575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:13.194594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:13.195446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:13.196197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:13.197379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:13.198157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:13.198873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:13.225999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:13.349149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:13.358313 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:13.373407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:13.374983 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4cdb3364-0d5c-4aae-ba0e-a2960e532cc9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.198732 Sep 09 06:32:13.376061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 215/420] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:13 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:32:14.401379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:14.402173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:14.409286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:14.410090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:14.410540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:14.411461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:14.411956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:14.412569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:14.552900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:14.561403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:14.562851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:14.564041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f7b88ec7-fca8-43d2-b549-5ed6bf2f0bc8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.167294 Sep 09 06:32:14.564608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 206/421] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:14 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:15.590074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:15.590701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:15.597483 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:15.597968 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:15.598655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:15.599337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:15.599878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:15.600304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:15.742822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:15.751293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:15.752852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:15.754006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2c170a5b-daad-4559-b2d6-90227230f802 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.167954 Sep 09 06:32:15.754563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 216/422] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:15 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:16.780422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:16.782193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:16.789158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:16.789957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:16.790586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:16.791299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:16.791783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:16.792345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:16.932576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:16.941297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:16.942745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:16.944087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-388e0248-12e7-44b6-8d22-d6895bfb6deb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.168094 Sep 09 06:32:16.944689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 207/423] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:16 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:17.048638 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c62623b-7e68-4f47-a439-8630eb0a8c3b", "device": "/dev/sdb"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:32:17.052186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:17.058564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:17.059052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:17.059489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:17.060214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:17.060680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:17.061104 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:17.972668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:17.974404 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:17.981517 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:17.982320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:17.983136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:17.984647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:17.985292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:17.986076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:18.131864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:18.149073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:18.150523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:18.151714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b78cd7e5-a92e-48ad-9219-562e4c987a1b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.184989 Sep 09 06:32:18.152349 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 208/424] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:17 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:19.178114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:19.178826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:19.184877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:19.185372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:19.185849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:19.186545 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:19.187005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:19.187434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:19.339427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:19.349136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:19.350697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:19.351761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-90ab7ba8-6a0c-46ee-b084-9367443af626 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.178324 Sep 09 06:32:19.352481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 209/425] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:19 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:32:20.350999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5081d57c-4467-4413-8b28-aed4757106e7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "POST /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.306251 Sep 09 06:32:20.351987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 217/426] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:32:17 2022] POST /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f/os-volume_attachments => generated 194 bytes in 3308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:32:20.376389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:20.377859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:20.384149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:20.384907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:20.385347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:20.386054 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:20.386513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:20.386937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:20.530310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:20.539290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:20.540824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:20.542101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-19d33722-93a2-4207-88dc-2b99f89571a5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.169636 Sep 09 06:32:20.542656 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 210/427] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:20 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:21.570021 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:21.570844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:21.577261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:21.577757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:21.578191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:21.578883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:21.579341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:21.580427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:21.712757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:21.721397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:21.722898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:21.724467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fb849492-4944-49f5-be8e-53138f68788c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.159285 Sep 09 06:32:21.724981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 218/428] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:21 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:22.749024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:22.749664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:22.755866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:22.756358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:22.756797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:22.757487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:22.757947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:22.758372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:22.894362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:22.903090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:22.906312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:22.906312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-11c421f7-183b-467d-9341-0affbc36e053 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.160580 Sep 09 06:32:22.906312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 211/429] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:22 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:23.931233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:23.931867 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:23.934338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=32 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:23.939900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:23.940404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:23.940839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:23.941533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:23.941984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:23.942400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:24.143442 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:24.152432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:24.153883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:24.155054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-588c67f7-5f2b-4ffa-93eb-5d7461e96c48 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.228362 Sep 09 06:32:24.155643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 219/430] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:23 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:25.181565 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:25.182182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:25.188430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:25.189447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:25.189885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:25.190584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:25.191043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:25.191470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:25.328707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:25.338383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:25.339863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:25.341247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e58ce67d-e6c2-423a-8ccf-f2eaeaf00e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.163830 Sep 09 06:32:25.341800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 212/431] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:25 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:26.367731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:26.368501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:26.374868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:26.375352 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:26.375823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:26.376629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:26.377192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:26.377624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:26.507348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:26.515795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:26.518275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:26.519456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2bdf9cb7-0578-4c6f-9ac4-cf0323507fcd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155699 Sep 09 06:32:26.520049 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 220/432] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:26 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:27.545129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:27.545737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:27.552169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:27.552662 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:27.553093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:27.553794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:27.554248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:27.554664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:27.558736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=91 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:27.691260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:27.700266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:27.701710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:27.702862 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c59303c0-4b73-4c3c-b90d-446de96f1b99 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.161715 Sep 09 06:32:27.703411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 213/433] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:27 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:28.728284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:28.728958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:28.737297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:28.737803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:28.738264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:28.739169 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:28.739703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:28.740263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:28.873967 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:28.883203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:28.884669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:28.885825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ffe6d3f5-0748-4007-bebd-d73838612d7e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.161669 Sep 09 06:32:28.886381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 221/434] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:28 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:29.911387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:29.912407 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:29.918373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:29.918868 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:29.919309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:29.920064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:29.920527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:29.920953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:30.120642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:30.120642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:30.120855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:30.120855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-704adf94-8276-47f6-862f-e682331260bc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.212959 Sep 09 06:32:30.128838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 214/435] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:29 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:31.148959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:31.150777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:31.159495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:31.160040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:31.160792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:31.161714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:31.162927 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:31.163516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:31.312200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:31.322116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:31.323856 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:31.325043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e51b9fa4-bf5f-403b-88ba-d1aefed1a511 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.180568 Sep 09 06:32:31.325593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 222/436] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:31 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:32.353878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:32.354487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:32.360533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:32.361048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:32.361466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:32.362162 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:32.362627 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:32.363050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:32.493248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:32.501974 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:32.503418 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:32.504607 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0b6190bf-e8ec-4edd-9bb5-7be2287fb97f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.154663 Sep 09 06:32:32.505164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 215/437] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:32 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:33.531128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:33.531857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:33.539391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:33.539933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:33.540365 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:33.541069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:33.541551 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:33.541989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:33.681953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:33.691289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:33.692896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:33.694042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-372adfad-0394-4873-9215-28288e852f81 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.167729 Sep 09 06:32:33.694584 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 223/438] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:33 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:34.720797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:34.721397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:34.727996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:34.728484 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:34.728921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:34.729609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:34.730065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:34.730489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:34.863333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:34.871885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:34.873321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:34.874476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e841bb20-d8e8-49d5-b733-808a83efb117 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.157662 Sep 09 06:32:34.875034 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 216/439] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:34 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:35.900280 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:35.900892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:35.907438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:35.908047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:35.908510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:35.909204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:35.909663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:35.910090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:36.039285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:36.047818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:36.050043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:36.051206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-30e9922e-0523-4e98-ae44-a04232d7f1a2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.154882 Sep 09 06:32:36.051795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 224/440] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:35 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:37.079346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:37.080858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:37.087389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:37.088271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:37.089045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:37.090287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:37.091122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:37.091946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:37.226012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:37.234493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:37.236093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:37.237494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b897f071-f750-422d-87d2-88069757976b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.163470 Sep 09 06:32:37.238066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 217/441] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:37 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:38.263979 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:38.265211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:38.272327 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:38.272811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:38.273244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:38.274011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:38.274479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:38.274902 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:38.402518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:38.410905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:38.412363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:38.413510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d38658d3-9dd4-4c67-a2e9-309c8f4089ae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.153845 Sep 09 06:32:38.414071 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 225/442] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:38 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:39.438947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:39.439682 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:39.441438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=30 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:39.446684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:39.447169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:39.447628 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:39.448323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:39.448803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:39.449230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:39.577800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:39.586343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:39.587824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:39.588986 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-327ee76b-f5b4-417a-9448-53d184e5ff18 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.154020 Sep 09 06:32:39.589538 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 218/443] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:39 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:40.615709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:40.616303 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:40.622741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:40.623224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:40.623682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:40.624365 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:40.624821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:40.625246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:40.757769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:40.766687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:40.768642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:40.770891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d3c38e2c-c82d-4a3f-b1a6-ee6600a91f15 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.159196 Sep 09 06:32:40.771980 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 226/444] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:40 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:32:41.797000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:41.797615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:41.804172 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:41.804664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:41.805100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:41.805793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:41.806255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:41.806679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:41.934747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:41.943898 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:41.945345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:41.946518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-77bd50b1-158c-402b-bd08-97ffd24a917e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.153395 Sep 09 06:32:41.947073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 219/445] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:41 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:42.972324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:42.973183 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:42.979670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:42.980158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:42.980596 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:42.981286 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:42.981763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:42.982172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:43.117998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:43.127314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:43.128929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:43.130073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-226977ee-8c19-4aaa-9dca-9888b7ab7bf1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.162313 Sep 09 06:32:43.130653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 227/446] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:42 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:44.156919 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:44.157962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:44.164205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:44.164686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:44.165118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:44.165805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:44.166271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:44.166693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:44.295716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:44.305052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:44.306503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:44.307723 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-25e4601f-27c6-42c5-bcac-018aa185ac2b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155311 Sep 09 06:32:44.308284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 220/447] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:44 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:45.334574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:45.335190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:45.348660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:45.349153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:45.349585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:45.350289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:45.351383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:45.351837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:45.354800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:45.507094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:45.515815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:45.518059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:45.519256 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-97a658bd-3f33-45cc-9a7b-541699f9f384 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.188917 Sep 09 06:32:45.519849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 228/448] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:45 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:46.544559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:46.545149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:46.551439 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:46.551955 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:46.552393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:46.553079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:46.553541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:46.553966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:46.684576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:46.693115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:46.694540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:46.695723 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8d4a2546-ab45-47cf-b7a9-1bff4dd18d12 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155204 Sep 09 06:32:46.696276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 221/449] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:46 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:47.721817 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:47.722428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:47.729403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:47.729889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:47.730325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:47.731019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:47.731480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:47.731944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:47.861613 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:47.870266 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:47.871791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:47.872948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2c63c088-0a61-47de-833d-97cb10656f53 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155741 Sep 09 06:32:47.873536 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 229/450] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:47 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:48.898279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:48.898891 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:48.905245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:48.905732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:48.906167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:48.906859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:48.907587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:48.908030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.039885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:49.048441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:49.050662 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:49.051867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8fb903ff-4379-4177-b953-960d6c2684f6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.157464 Sep 09 06:32:49.052421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 222/451] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:48 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:49.142124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:49.142647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:49.149680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.150106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.150876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.151321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.151809 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.152446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.176736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d5666812-33e7-4342-a55d-f4cb894ec326 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.038424 Sep 09 06:32:49.177301 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 230/452] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:32:49 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:32:49.188791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bd833cd-802b-47a5-83d0-6d74f9352d7a"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:32:49.191168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:49.197037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.197635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.198077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.198763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.199229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.199677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.280497 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: POST /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/os-volume_attachments HTTP/1.1 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 74 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:32:49.282336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {"volumeAttachment": {"volumeId": "9bd833cd-802b-47a5-83d0-6d74f9352d7a"}} Sep 09 06:32:49.283991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'server_id': 'af89a0ac-56b7-4efa-aa9b-69e8c6b358c2', 'body': {'volumeAttachment': {'volumeId': '9bd833cd-802b-47a5-83d0-6d74f9352d7a'}}} Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:32:49.285791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:32:49.287208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 400 to user: Invalid volume: volume 9bd833cd-802b-47a5-83d0-6d74f9352d7a is already attached to instances: 1032ded3-aab9-4275-bad0-aef089a44bdc {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6e1d0883-1a13-42ef-b757-26adf444bfb1 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098993 Sep 09 06:32:49.288904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 223/453] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:32:49 2022] POST /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:32:49.293307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:49.293839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:49.299887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.301202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.301639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.302444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.302914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.303351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.327526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:32:49.415387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a43e9e1c-536f-4f41-bfff-11b56b544ab4 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 204 len: 0 microversion: 2.1 time: 0.125592 Sep 09 06:32:49.416172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 231/454] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:32:49 2022] DELETE /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 06:32:49.424423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:49.425877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:49.429975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 06:32:49.430144 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Fri Sep 9 06:32:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 (ip 10.222.0.25) !!! Sep 09 06:32:49.435872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.436372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.436812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.437515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.437976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.438403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.576696 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:49.586023 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2e0e5250-2b79-48e5-84fe-6f33bc71693e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1680 microversion: 2.1 time: 0.165636 Sep 09 06:32:49.586601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 224/455] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:49 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:49.745367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "name": "network-vif-plugged", "status": "completed", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:32:49.754823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:49.755309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:49.755846 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:49.766669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] Creating event network-vif-plugged:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:32:49.772308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-2f925cc1-5bfe-49b0-ac8c-7752d1bc4b58 req-45bd1f2c-95b8-4096-88fc-a852e8eaa008 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Sep 09 06:32:49.772904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 232/456] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:32:50.077650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:50.078163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:50.085294 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:50.085776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:50.086206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:50.086884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:50.087339 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:50.087786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:50.218022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:50.227994 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:50.229430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:50.230583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-35f46428-4b3b-4079-abc0-61b82bacff0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.156954 Sep 09 06:32:50.231411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 225/457] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:50 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:50.613633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:50.614326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:50.620491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:50.620972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:50.621396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:50.622126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:50.622527 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:50.622944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:50.751796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:50.760087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cf391fb0-2cdc-46b4-8f9d-35c7e46655ae tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1680 microversion: 2.1 time: 0.151438 Sep 09 06:32:50.760650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 233/458] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:50 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:51.258182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:51.258798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:51.264803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:51.265286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:51.265719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:51.266403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:51.266860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:51.267281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:51.397828 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:51.406797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:51.408280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:51.409993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4e815961-26bf-4f77-a3fd-d83cbf948e83 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.155954 Sep 09 06:32:51.410550 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 226/459] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:51 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:51.784492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:51.785610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:51.792121 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:51.792654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:51.793083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:51.793761 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:51.794274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:51.794737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:51.924688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:51.932443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bd29b1e6-8510-4741-a91d-a37d53ecfb77 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1680 microversion: 2.1 time: 0.152069 Sep 09 06:32:51.933002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 234/460] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:51 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:52.435816 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:52.436423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:52.443322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:52.443843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:52.444279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:52.444970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:52.445433 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:52.445868 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:52.573806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:52.582512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:52.583979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:52.585126 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7694c1d0-224e-41ff-88be-18f571d82c38 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.153266 Sep 09 06:32:52.585672 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 227/461] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:52 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:52.955531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:52.956267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:52.962640 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:52.963124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:52.963571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:52.964302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:52.964758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:52.965183 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:53.095863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:53.104388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-977241df-8129-42bc-b6dd-abc8d228ad94 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1680 microversion: 2.1 time: 0.152712 Sep 09 06:32:53.104952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 235/462] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:52 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:53.610247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:53.610856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:53.617028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:53.617514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:53.617948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:53.618630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:53.619087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:53.619508 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:53.746055 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:53.755787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:53.757664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:53.758832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-82cb9cd6-d40d-4aab-b8b1-f2ffbed159fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.152555 Sep 09 06:32:53.759623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 228/463] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:53 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:54.132981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:54.134285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:54.137118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:54.143731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:54.144216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:54.144646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:54.145336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:54.145786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:54.146465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:54.426752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:54.435355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3ef4fa8f-d1a9-4bad-bb94-370202982536 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1680 microversion: 2.1 time: 0.310005 Sep 09 06:32:54.435951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 236/464] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:54 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:54.786946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:54.789019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:54.796784 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:54.797948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:54.798886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:54.799872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:54.801346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:54.801940 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:55.314887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:55.317163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:32:55.326207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:55.327642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:55.328814 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-31ab16e0-c342-49b4-abc0-cc3dc359d7c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.547552 Sep 09 06:32:55.329393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 229/465] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:54 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:55.461092 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:55.461703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:55.469105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:55.469863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:55.470288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:55.471148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:55.471620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:55.472287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:55.548670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af89a0ac-56b7-4efa-aa9b-69e8c6b358c2", "name": "network-vif-deleted", "tag": "d57c2843-153e-4f69-85d4-96c12063b672"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:32:55.559973 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:55.560557 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:55.561051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:55.574383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:55.581003 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] Creating event network-vif-deleted:d57c2843-153e-4f69-85d4-96c12063b672 for instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 on hv-cinder-85220 Sep 09 06:32:55.582456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ca40fb1a-03e2-4f48-9bed-a8eebecc48fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1613 microversion: 2.1 time: 0.126247 Sep 09 06:32:55.587073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-488aa76b-e300-4092-95f1-90d1a53dd8a4 req-1cd2bded-5b87-41d5-b336-7161c60367ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047277 Sep 09 06:32:55.588080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 230/466] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:32:55.600496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 237/467] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:55 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:56.357295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:56.357998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:56.365029 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:56.365715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:56.366242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:56.367158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:56.367640 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:56.368193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:56.523494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:56.533528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:56.535193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:56.537122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-94c706bc-2239-4928-b507-4cec3d1dea86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.184673 Sep 09 06:32:56.537984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 231/468] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:56 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:56.613974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:56.616222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:56.623474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:56.624015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:56.624449 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:56.625157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:56.625674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:56.626104 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:56.703911 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:56.712743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1acc8077-51b3-4300-bb8c-9f6b39f0c7c2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1613 microversion: 2.1 time: 0.102740 Sep 09 06:32:56.713315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 238/469] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:56 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:57.564847 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:57.565452 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:57.572435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:57.572918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:57.573367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:57.574051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:57.574503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:57.574922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:57.708595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:57.717861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:57.719314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:57.720504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2e2831ce-e155-4ae0-8960-a79c3fc7a0ad tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.159585 Sep 09 06:32:57.721065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 232/470] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:57 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:57.736511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:57.737079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:57.743765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:57.744255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:57.744686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:57.745378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:57.745838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:57.746263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:57.808125 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:57.815890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a749e37f-785a-4f24-afeb-bf79edbea548 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1613 microversion: 2.1 time: 0.083439 Sep 09 06:32:57.816459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 239/471] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:57 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:32:58.746957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:58.747565 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:58.753468 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:58.753957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:58.754396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:58.755082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:58.755571 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:58.756669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:58.839814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:58.840431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:58.847117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:58.848052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:58.848389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:58.851752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:58.852233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:58.852672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:58.905951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:58.917951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:58.919504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:58.920765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3ec9e6a3-420f-4d70-8b89-eab142956a36 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.177770 Sep 09 06:32:58.930584 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 233/472] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:58 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:32:58.930708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:32:58.932783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-07e5f786-8274-49f0-88df-aba5e2636ba7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1613 microversion: 2.1 time: 0.096706 Sep 09 06:32:58.933351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 240/473] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:58 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:32:59.946943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:59.947598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:59.955202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:59.955700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:59.956141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:59.956845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:59.957092 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:32:59.957539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:59.957703 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:59.957910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:32:59.964661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:59.965159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:59.965584 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:32:59.966295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:32:59.966750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:32:59.967170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:00.013650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:00.014153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:00.014586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:00.018188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:00.089866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:00.101832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2edad536-0ceb-4731-bcb2-037c5c0d34f3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 200 len: 1330 microversion: 2.1 time: 0.148970 Sep 09 06:33:00.102434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 241/474] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:32:59 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:00.175211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:00.185812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:00.187706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:00.189091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-694dbabd-9164-498b-bd80-cedf765b192a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1808 microversion: 2.20 time: 0.246713 Sep 09 06:33:00.189649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 234/475] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:32:59 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:01.127752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:01.128370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:01.135400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.135914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.136345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:01.137032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.137491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.137914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:01.154691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 HTTP/1.1 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:33:01.156526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:33:01.158100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'af89a0ac-56b7-4efa-aa9b-69e8c6b358c2'} Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:33:01.159097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:33:01.160611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:01.162039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:33:01.162039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-92b651e2-ca40-4275-8489-98f3b66eabca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 404 len: 111 microversion: 2.1 time: 0.033901 Sep 09 06:33:01.162039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 242/476] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:01 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:33:01.168757 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6b171dab-f5fb-4290-809b-178e3951f255 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '.version_select at 0x7f74ad12b280>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:01.191929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6b171dab-f5fb-4290-809b-178e3951f255 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410572750" status: 202 len: 0 microversion: 2.1 time: 0.026690 Sep 09 06:33:01.192885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 235/477] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 9 06:33:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410572750 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 06:33:01.217030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:01.218088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:01.225697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.226196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.226634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:01.227369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.228132 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.228567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:01.385068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:01.407110 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:01.410076 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:01.411557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-592600b1-e105-4151-9743-8a1638b354f5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1795 microversion: 2.20 time: 0.199215 Sep 09 06:33:01.412771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 243/478] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:01 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1795 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:01.920308 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:01.920946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:01.927016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.928147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.928886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:01.929583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:01.930040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:01.930458 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:02.064424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'services' on Instance uuid 1032ded3-aab9-4275-bad0-aef089a44bdc {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:02.177666 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-29021ef1-afa8-4f42-90dd-7ada5a4a7eef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments/9bd833cd-802b-47a5-83d0-6d74f9352d7a" status: 202 len: 0 microversion: 2.1 time: 0.260941 Sep 09 06:33:02.178306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 236/479] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:33:01 2022] DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments/9bd833cd-802b-47a5-83d0-6d74f9352d7a => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:02.187237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:02.189675 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:02.196794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:02.197178 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:02.197690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:02.198480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:02.199026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:02.199455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:02.214081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:02.233990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3231a49e-70ea-46d3-8b5c-5173569ebb21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050930 Sep 09 06:33:02.235574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 244/480] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:33:02 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:03.249301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:03.252450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:03.258872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.259352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.259807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.260504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.260955 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.261373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.293268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-54ed1324-a326-4bbf-9c90-185c432ba99a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049558 Sep 09 06:33:03.294043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 237/481] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:33:03 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:33:03.359266 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:03.359808 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:03.367187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.367702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.368142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.368838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.369292 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.369714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.400967 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:33:03.407348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:03.407877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:03.414347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.414833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.415264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.416035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.416496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.416918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.488727 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ab5da94a-c8f9-4541-9eaa-0ae68ae6aa2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 204 len: 0 microversion: 2.1 time: 0.132723 Sep 09 06:33:03.489800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 245/482] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:33:03 2022] DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:33:03.499753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:03.500407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:03.506951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.507445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.507916 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.508645 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:03.509103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:03.509581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:03.525948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lazy-loading 'services' on Instance uuid a2e4b142-0395-4891-b700-e87c3628fa1f {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:03.615887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3bf37a33-2580-4255-b121-d32f25ec8425 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f/os-volume_attachments/9c62623b-7e68-4f47-a439-8630eb0a8c3b" status: 202 len: 0 microversion: 2.1 time: 0.211697 Sep 09 06:33:03.616478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 238/483] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:33:03 2022] DELETE /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f/os-volume_attachments/9c62623b-7e68-4f47-a439-8630eb0a8c3b => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 06:33:03.653937 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:03.661718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-55c61d77-bfea-4b4c-aab4-12050156e5b8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1684 microversion: 2.1 time: 0.166960 Sep 09 06:33:03.662415 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 246/484] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:03 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:04.688369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:04.689205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:04.695686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:04.696177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:04.696619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:04.697315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:04.697778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:04.698206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:04.836727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:04.844895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a6953956-fb29-4eef-aa63-3b4a2b21a6fa tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1684 microversion: 2.1 time: 0.160671 Sep 09 06:33:04.845652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 239/485] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:04 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:05.868403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:05.869039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:05.875563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:05.876048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:05.876477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:05.877152 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:05.877603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:05.878016 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:06.007460 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:06.015673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d8d5b2ec-ee36-4ab3-8959-543c028236d3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1684 microversion: 2.1 time: 0.151953 Sep 09 06:33:06.016236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 247/486] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:05 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:06.868980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:06.870070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:06.877082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:06.877581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:06.878014 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:06.879347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:06.879913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:06.880341 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:06.893061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1032ded3-aab9-4275-bad0-aef089a44bdc", "name": "network-vif-deleted", "tag": "837586c2-7c46-4e73-876b-89de8eba416d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:06.908109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:06.908884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:06.909080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:33:06.909959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:06.925527 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] Creating event network-vif-deleted:837586c2-7c46-4e73-876b-89de8eba416d for instance 1032ded3-aab9-4275-bad0-aef089a44bdc on hv-cinder-85220 Sep 09 06:33:06.932320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-d16d8135-a7b5-4961-bf16-3c53c53d2903 req-d2ef0226-72d8-4788-b0c6-054a557057df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043721 Sep 09 06:33:06.933230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 248/487] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:33:07.030426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d122cd7c-5bb8-484d-915d-098d9a718270 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 204 len: 0 microversion: 2.1 time: 0.165822 Sep 09 06:33:07.031018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 240/488] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:33:06 2022] DELETE /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:33:07.044222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:07.045453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:07.047874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:07.048675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:07.055321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:07.055767 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:07.056202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:07.056906 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:07.057211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:07.057362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:07.057688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:07.057989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:07.058508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:07.059655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:07.060267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:07.061003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:07.094093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:07.094581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:07.095011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:07.095464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 1032ded3-aab9-4275-bad0-aef089a44bdc {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:07.172335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:07.183260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-96cb58ec-d0bb-4b5a-a3a3-26292edc4acf tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1332 microversion: 2.1 time: 0.140520 Sep 09 06:33:07.184347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 241/489] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:07 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:07.248172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:07.255974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-04767abb-483f-41df-82fd-4f426ecbd9c7 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1512 microversion: 2.1 time: 0.219571 Sep 09 06:33:07.256554 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 249/490] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:07 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:08.206520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:08.207131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:08.213344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:08.213829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:08.214260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:08.214975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:08.215427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:08.215875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:08.246924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:08.247392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:08.247853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:08.248290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 1032ded3-aab9-4275-bad0-aef089a44bdc {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:08.279480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:08.280108 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:08.288119 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:08.288838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:08.289427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:08.290281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:08.290620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:08.291088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:08.291692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:08.298360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c03fe30a-1413-445c-ae5f-1cbceade30e9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1332 microversion: 2.1 time: 0.095653 Sep 09 06:33:08.299129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 242/491] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:08 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:08.421334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:08.429665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fa48ca9f-3567-40a0-96b6-bf56e735bc3c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1512 microversion: 2.1 time: 0.153967 Sep 09 06:33:08.430229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 250/492] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:08 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:09.322105 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:09.322668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:09.328809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:09.329298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:09.329743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:09.330422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:09.330889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:09.331314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:09.363851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:09.364343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:09.364781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:09.365793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 1032ded3-aab9-4275-bad0-aef089a44bdc {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:09.412464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:09.420726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0b81ca59-a80a-490a-abee-b926f81ca64a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 200 len: 1332 microversion: 2.1 time: 0.102995 Sep 09 06:33:09.421493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 243/493] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:09 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:09.452573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:09.453188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:09.459952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:09.460471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:09.460909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:09.461620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:09.462082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:09.462509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:09.693003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:09.702642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6a30b987-934e-400c-adba-9c018d9e9a3b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1512 microversion: 2.1 time: 0.253877 Sep 09 06:33:09.703223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 251/494] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:09 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:10.033413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2e4b142-0395-4891-b700-e87c3628fa1f", "name": "network-vif-deleted", "tag": "d09eea98-ba89-41b9-a4b1-5d95810e5290"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:10.041097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:10.048307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.048881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.049389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.055567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:10.064202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] Creating event network-vif-deleted:d09eea98-ba89-41b9-a4b1-5d95810e5290 for instance a2e4b142-0395-4891-b700-e87c3628fa1f on hv-cinder-85220 Sep 09 06:33:10.069667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-50893aba-dee6-4d67-86d7-3a9b6753166f req-b63486f6-ea93-4e69-a846-52d538c0f23a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040079 Sep 09 06:33:10.070347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 244/495] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:10.448621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:10.449158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:10.455297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.455869 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.456229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.456913 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.457387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.457784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.471844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc HTTP/1.1 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:33:10.473716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:33:10.476191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '1032ded3-aab9-4275-bad0-aef089a44bdc'} Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:33:10.477055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:33:10.478434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:10.479704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:33:10.479704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bd073d50-5bbc-4df7-9196-04ff88aa2d65 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 404 len: 111 microversion: 2.1 time: 0.031013 Sep 09 06:33:10.479704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 252/496] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:10 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:33:10.485608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-529b0024-9ede-4c5c-9dd9-4a53e7a70ca9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '.version_select at 0x7f74ad2333a0>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:10.505038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-529b0024-9ede-4c5c-9dd9-4a53e7a70ca9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088411147" status: 202 len: 0 microversion: 2.1 time: 0.024065 Sep 09 06:33:10.505754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 245/497] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 9 06:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088411147 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 06:33:10.726375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:10.727224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:10.733516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.734237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.734835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.735890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.736503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.737112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.784725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:10.785511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:10.785652 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:10.786312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lazy-loading 'fault' on Instance uuid a2e4b142-0395-4891-b700-e87c3628fa1f {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:10.842239 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:10.850042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1412c657-f714-463d-8026-dea062a0417b tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 200 len: 1308 microversion: 2.1 time: 0.128465 Sep 09 06:33:10.856277 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 253/498] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:10 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:11.182670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ed250a1e-2917-49f1-996f-a8d1a4dd5736 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: .version_select at 0x7f74ad376310>, body: {"keypair": {"name": "tempest-keypair-1113541636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDf9SpIjWR511fD/H9nWmrSgiyN0r7gJpx/Nwg5b/i72j3mYnDdNEEWrZoBEQ+Px3FllYJ5wNT71xVejObg4S2HP5V28r7i9R/MM+Hbn/n9r5WuABanlA4C6lRBHKdZjHg=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:11.199884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-ed250a1e-2917-49f1-996f-a8d1a4dd5736 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:33:11.206961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-ed250a1e-2917-49f1-996f-a8d1a4dd5736 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:33:11.232033 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ed250a1e-2917-49f1-996f-a8d1a4dd5736 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055007 Sep 09 06:33:11.232636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 246/499] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:33:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:11.873245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:11.873834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: a2e4b142-0395-4891-b700-e87c3628fa1f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:11.880610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:11.881176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:11.881631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:11.882328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:11.882785 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:11.883211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:11.897806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] HTTP exception thrown: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Request method failure captured: Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f HTTP/1.1 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt2xhvaQLcmdSw1hkdAElRF7SLCWAYLqawXLU4pU7npRFftt0KuL6qh1IWKNpVmFksiSrqU-cG1rE4EipflWSiPuwbyM2jdL5ivOrHUMn78zKAw0RbwiOUVA9zYFnPcn9I69Z1zYH-tIWhcaI79laA_0YphuuqRM0ogrLAU3zUuXLDg Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 9c96a5a4edc84b70a31c6b0cd2a8f864 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:33:11.899331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 9c96a5a4edc84b70a31c6b0cd2a8f864 Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesSnapshotTestJSON-1921450041-project Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 4659e9d9c65e436aa101db62a801a5fe Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesSnapshotTestJSON-1921450041-project Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. Sep 09 06:33:11.900896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'a2e4b142-0395-4891-b700-e87c3628fa1f'} Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:33:11.905123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. Sep 09 06:33:11.906594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:33:11.907859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Returning 404 to user: Instance a2e4b142-0395-4891-b700-e87c3628fa1f could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:33:11.907859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-871faa8e-caf6-4500-81b8-434a45a67a82 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f" status: 404 len: 111 microversion: 2.1 time: 0.031460 Sep 09 06:33:11.907859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 254/500] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:11 2022] GET /compute/v2.1/servers/a2e4b142-0395-4891-b700-e87c3628fa1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:33:12.513518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-810843470", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a1e56b2-5174-4859-ad55-8ae965984c50"}], "security_groups": [{"name": "tempest-securitygroup--106489718"}], "key_name": "tempest-keypair-1113541636", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:12.624062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] validate_networks() for [('6a1e56b2-5174-4859-ad55-8ae965984c50', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:33:12.986729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:33:12.987153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:33:12.987663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:33:12.988076 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:33:12.988489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:33:12.997264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:12.997751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:12.998185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:12.998915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:12.999374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:12.999842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:13.017074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:33:13.022467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:33:13.033680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:33:13.036085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:33:13.082365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6a25efff-9add-4f88-958b-c9ee2662dc8a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573147 Sep 09 06:33:13.083011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 247/501] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:33:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:33:13.097177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1025c49b-8af5-4acf-9b3e-412db2f49382 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:13.098094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1025c49b-8af5-4acf-9b3e-412db2f49382 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:13.152886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1025c49b-8af5-4acf-9b3e-412db2f49382 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:13.159825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1025c49b-8af5-4acf-9b3e-412db2f49382 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1241 microversion: 2.1 time: 0.069052 Sep 09 06:33:13.160397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 255/502] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:13 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:14.183514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:14.184142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:14.190296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:14.190771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:14.191198 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:14.191916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:14.192367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:14.192790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:14.257680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:14.265238 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-711b2729-0dd9-4b74-a50b-9135bd629b9f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1245 microversion: 2.1 time: 0.085702 Sep 09 06:33:14.265793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 248/503] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:14 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:15.289650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:15.290569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:15.298957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:15.299703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:15.300503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:15.301668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:15.303031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:15.303740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:15.372612 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:15.380480 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a62f6387-921a-41e5-bd3a-17a665ae3590 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1245 microversion: 2.1 time: 0.095322 Sep 09 06:33:15.381091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 256/504] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:15 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:15.491656 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:15.492362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:15.499183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:15.499705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:15.500245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:15.500943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:15.501403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:15.501827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:15.586741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lazy-loading 'services' on Instance uuid ebebb1d1-2de0-4afb-b816-797f5a4ed1ff {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:15.662915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5d1bb14e-e066-4daf-8282-2b02822dd7c5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments/08f07674-2e81-492e-84eb-0f1278842421" status: 202 len: 0 microversion: 2.1 time: 0.176087 Sep 09 06:33:15.663672 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 249/505] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:33:15 2022] DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments/08f07674-2e81-492e-84eb-0f1278842421 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:16.405619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:16.406961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:16.414204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.414881 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.415391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.416346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.417094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.417699 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.527895 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:16.536977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2eaaeb3a-04f3-4cf0-b3e4-2455a9541f02 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1301 microversion: 2.1 time: 0.136864 Sep 09 06:33:16.537863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 257/506] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:16 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:16.770095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7619c49-0d0f-44a8-8e05-cbd7120dc5e5"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:16.773483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:16.780049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.780644 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.781185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.782057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.782635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.783763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.815877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:16.832847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.834082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.834746 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.862719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Going to try to stop instance {{(pid=120795) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 06:33:16.925680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e5163674-9c17-4643-8ebb-e39928f73ed0 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action" status: 202 len: 0 microversion: 2.1 time: 0.112914 Sep 09 06:33:16.930109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 258/507] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:33:16 2022] POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:16.936706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:16.937732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:16.945753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.946409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.947035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:16.948014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:16.948686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:16.949422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:17.317437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-eb58e024-a836-4a02-8197-7cd8466886fc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552078 Sep 09 06:33:17.319204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 250/508] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:33:16 2022] POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:17.494397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:17.504072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-78f158f0-9628-4b41-99c8-7f5fe57c291c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.572299 Sep 09 06:33:17.505495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 259/509] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:16 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:17.563411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:17.564135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:17.577709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:17.578317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:17.578958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:17.579925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:17.580639 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:17.581053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:17.836889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:17.844907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-193e4730-a426-4cd0-9d4f-e7eb01c2a615 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.286156 Sep 09 06:33:17.845466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 251/510] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:17 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:18.368500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7eb260-2b49-4a8f-bf7b-6098b136a4bb", "tag": "abab4c35-0202-452b-9ab3-3bda90e50057"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:18.379627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:18.380429 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:18.380955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:18.397733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] Creating event network-changed:abab4c35-0202-452b-9ab3-3bda90e50057 for instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb on hv-cinder-85220 Sep 09 06:33:18.404128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-02c9c065-e1cf-4fbf-b1cd-cf0cdb6ee01c req-cb67be2b-5120-479c-98ae-13162ca921f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041821 Sep 09 06:33:18.405245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 260/511] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:18.527681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:18.528299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:18.534754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:18.535455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:18.535920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:18.537301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:18.537763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:18.538190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:18.682824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:18.692747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-239b9725-eead-4e5a-87ee-1d0d8d2d4b97 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.168516 Sep 09 06:33:18.706529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 252/512] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:18 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:18.869424 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:18.870142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:18.877046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:18.877456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:18.877894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:18.878618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:18.879125 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:18.879573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:19.022890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:19.025196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:19.032313 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8621ffad-28b6-47d1-bcb9-b1169b0d06c0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.167706 Sep 09 06:33:19.032891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 261/513] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:18 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:19.716360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:19.716999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:19.723604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:19.724780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:19.725212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:19.725915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:19.726376 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:19.726801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:19.855309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:19.862860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-68e2dfd0-aed4-45bb-ae0a-fa4d52932b84 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.150382 Sep 09 06:33:19.863414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 253/514] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:19 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:20.055642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:20.056172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:20.063273 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:20.063784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:20.064216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:20.064902 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:20.065358 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:20.065779 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:20.191978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:20.200498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ae4f57aa-40e2-4ba8-b577-76c699caf90c tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.149134 Sep 09 06:33:20.201063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 262/515] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:20 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:20.868732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-703394477", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "networks": [{"uuid": "13f47cc6-2087-46cd-8f70-e93a65643080"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:20.886169 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:20.886909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:20.893281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:20.893805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:20.894233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:20.894945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:20.895398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:20.895921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:20.928572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] validate_networks() for [('13f47cc6-2087-46cd-8f70-e93a65643080', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:33:21.189942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:21.198514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cf3f9ae5-0881-4662-9f2a-2eb9fc06cd6d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.316150 Sep 09 06:33:21.199099 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 263/516] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:20 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:21.223430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:21.224894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:21.230810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:21.231367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:21.231903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:21.232601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:21.233091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:21.233517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:21.543047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:21.551834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a09d574a-68b9-4531-9d4c-0fb423476120 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.332286 Sep 09 06:33:21.552938 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 264/517] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:21 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:21.618302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:33:21.618860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:33:21.619405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:33:21.619929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:33:21.620414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:33:21.629282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:21.629713 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:21.630216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:21.631000 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:21.631465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:21.631924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:21.648870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Getting quotas for project 9c96a5a4edc84b70a31c6b0cd2a8f864. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:33:21.652895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Getting quotas for user 4659e9d9c65e436aa101db62a801a5fe and project 9c96a5a4edc84b70a31c6b0cd2a8f864. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:33:21.664368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:33:21.666725 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:33:21.710324 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0e9a68ce-db77-40f5-b6f4-d17fbc826600 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845981 Sep 09 06:33:21.710971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 254/518] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:33:21.722004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-39058598-ce7d-46b2-9731-e3ee98837513 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:21.722902 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-39058598-ce7d-46b2-9731-e3ee98837513 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:21.779367 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-39058598-ce7d-46b2-9731-e3ee98837513 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:21.786147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-39058598-ce7d-46b2-9731-e3ee98837513 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1218 microversion: 2.1 time: 0.068033 Sep 09 06:33:21.787258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 265/519] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:21 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:22.222933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:22.223505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:22.232050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.232547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.232986 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.233685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.234147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.234575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.365548 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:22.373310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-314072d6-c25e-4006-86ca-1f72d46f0f2f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.155091 Sep 09 06:33:22.373878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 255/520] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:22 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:22.574641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:22.575253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:22.581835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.582384 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.582825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.583582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.584033 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.584464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.734616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:22.742923 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d54f5ca5-5419-4558-9cf6-a601a120ebf9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.172192 Sep 09 06:33:22.743500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 266/521] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:22 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:22.809318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:22.809970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:22.816046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.816540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.816978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.817761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:22.818219 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:22.818663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:22.884588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:22.892088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c1a73b9a-13bc-4239-9f72-e7246795cc07 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1270 microversion: 2.1 time: 0.086741 Sep 09 06:33:22.892649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 256/522] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:22 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:23.396822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:23.397344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:23.405043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.405545 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.406163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:23.407177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.407669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.408685 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:23.565578 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:23.573710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a3e4c8a6-55e8-448e-b047-59e5f3a59021 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.181201 Sep 09 06:33:23.574284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 267/523] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:23 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:23.765865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:23.767605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:23.775319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.775842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.776266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:23.776960 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.777432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.777849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:23.921443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:23.925682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:23.937829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.942835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.943818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:23.945070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:23.945803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:23.946404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:24.065223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:24.067983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:24.075311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3bb69872-3bf3-4bff-8281-ad14b3d9514a tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1270 microversion: 2.1 time: 0.163957 Sep 09 06:33:24.076027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-73a41638-3009-4148-8dd3-da3e301406dd tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.314170 Sep 09 06:33:24.076291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 268/524] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:23 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:24.081184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 257/525] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:23 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:24.596671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:24.597491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:24.600219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:24.605544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:24.606034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:24.606493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:24.607216 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:24.607714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:24.608137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:24.884278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:24.891948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:24.893219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4b0cb9a1-0cdf-441a-a864-0b1fc08aa651 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.300496 Sep 09 06:33:24.893901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 269/526] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:24 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:24.899848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:24.901569 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:24.902060 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:24.902502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:24.903189 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:24.903875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:24.904309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:24.927568 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'flavor' on Instance uuid fc563f30-0bc9-4f2d-a07f-5c18471ec9fd {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:25.059108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7818f408-6ae2-4e4c-80a5-1334740a0f7d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/action" status: 200 len: 32 microversion: 2.1 time: 0.170997 Sep 09 06:33:25.062980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 258/527] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:33:24 2022] POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 06:33:25.069920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:25.070617 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:25.077388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.077960 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.078482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.079253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.079814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.080241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.100552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:25.101664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:25.109156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.109749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.110244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.111145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.111637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.112062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.225736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:25.233313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fae6275d-6de5-4041-9a4d-2913e2482d85 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1276 microversion: 2.1 time: 0.138441 Sep 09 06:33:25.243872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 259/528] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:25 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:25.243872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:25.243872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:25.248952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.249563 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.250002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.250700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.251157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.251606 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.711339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:25.722276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3f9860b7-508b-4ca3-afaf-f322679bc200 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.656575 Sep 09 06:33:25.724235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 270/529] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:25 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:25.818919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7eb260-2b49-4a8f-bf7b-6098b136a4bb", "name": "network-vif-plugged", "status": "completed", "tag": "abab4c35-0202-452b-9ab3-3bda90e50057"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:25.830928 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.831680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.832291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.843878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] Creating event network-vif-plugged:abab4c35-0202-452b-9ab3-3bda90e50057 for instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb on hv-cinder-85220 Sep 09 06:33:25.850451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-8c2cdf0f-6da2-4d8c-a02f-186aa7fc8f88 req-8237e083-191b-4fc3-a693-7613d6fce6c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036024 Sep 09 06:33:25.851287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 271/530] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:33:25.857564 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:25.860384 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:25.870438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c00a7d77-969f-45ad-9615-cd41d181f807 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.635516 Sep 09 06:33:25.884247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 260/531] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:25 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:25.918883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:25.919596 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:25.925684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.926160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.926667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:25.928228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:25.928687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:25.929105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.235915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:26.244037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6dfb90ff-19c7-49c0-9dcc-1fb8e485acfa tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.329347 Sep 09 06:33:26.244705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 272/532] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:25 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:26.257625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:26.258239 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:26.265887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.266382 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.266819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.267516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.268005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.268434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.633979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:26.641430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0647d7de-a3f6-42c5-8928-f5efbdf51866 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.388248 Sep 09 06:33:26.641996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 261/533] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:26 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:26.747758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:26.748314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:26.754170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.755236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.755874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.756572 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.757032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.757456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.894474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:26.895079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:26.901455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.901935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.902360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:26.903086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:26.903586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:26.903988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.023867 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:27.032774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-75c2b9f9-7261-43e0-a55e-f1904cb5bb1e tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.288960 Sep 09 06:33:27.033356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 273/534] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:26 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:27.144226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:27.152119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d26364c3-d501-4f21-8d89-dc862fd4c598 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1366 microversion: 2.1 time: 0.261584 Sep 09 06:33:27.152687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 262/535] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:26 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:27.249614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3940b0da-abbf-4a9c-b3af-6ba131a360e7", "tag": "eb727d25-2aa3-45c0-9c74-3a14389a8bb3"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:27.259777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:27.260192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:27.260619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.272937 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] Creating event network-changed:eb727d25-2aa3-45c0-9c74-3a14389a8bb3 for instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 on hv-cinder-85220 Sep 09 06:33:27.279133 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-78a75503-0d1e-485d-850b-23eeaf609c64 req-2ec3ad07-f7c1-469b-9e59-b11d51992923 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Sep 09 06:33:27.280054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 274/536] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:27.281929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:27.284798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:27.292206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:27.292700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:27.293166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.294191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:27.294937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:27.295368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.467220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:27.475674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3ba46410-6ffb-41f7-8cc1-4e5a4f8efd93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.211192 Sep 09 06:33:27.476249 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 263/537] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:27 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:27.668602 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:27.669407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:27.676084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:27.676941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:27.677741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.678532 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:27.679058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:27.679594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:27.819487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:27.827061 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-82185ca2-5899-4527-b629-3c6fe1f320ce tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.163809 Sep 09 06:33:27.827685 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 275/538] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:27 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:28.055825 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:28.056425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:28.062267 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.062749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.063179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.063884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.064342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.064761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.174340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:28.174946 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:28.181321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.181831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.182258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.182944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.183393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.183833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.313157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:28.322732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-df07f7b5-fe13-4a57-b52f-c75fd3cf6777 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.270999 Sep 09 06:33:28.323314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 264/539] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:28 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:28.392990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:28.400815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a1d9d586-4740-45fb-9511-2ab9c71958b7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1557 microversion: 2.1 time: 0.230293 Sep 09 06:33:28.401397 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 276/540] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:28 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1557 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:28.422700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:28.423194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:28.429768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.430190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.430622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.431383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.431790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.432212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.499363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:28.500168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:28.506669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.507240 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.507710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.508395 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.508855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.509273 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.527534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-052a21d0-9aa6-491b-bee5-9e0a8e0bf921 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108728 Sep 09 06:33:28.528161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 265/541] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:33:28 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:28.765718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:28.775483 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-72e5d003-8ec4-4f46-8030-5c80d380ba5d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.279833 Sep 09 06:33:28.776589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 277/542] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:28 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:28.850997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:28.851636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:28.857577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.858064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.858498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.859914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:28.859914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:28.860113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:28.993464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:29.001630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a41ccbaf-74a4-4128-a0cb-dde52de8d6e0 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.155327 Sep 09 06:33:29.002207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 266/543] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:28 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:29.346405 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:29.347020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:29.354458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:29.354974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:29.355413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:29.356188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:29.356660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:29.357082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:29.493102 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:29.501562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8021659a-7e70-46f8-802f-2ec67651fc85 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.159158 Sep 09 06:33:29.502141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 278/544] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:29 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:29.669298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7eb260-2b49-4a8f-bf7b-6098b136a4bb", "tag": "abab4c35-0202-452b-9ab3-3bda90e50057"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:29.678863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:29.679340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:29.679803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:29.690879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] Creating event network-changed:abab4c35-0202-452b-9ab3-3bda90e50057 for instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb on hv-cinder-85220 Sep 09 06:33:29.696674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-9f6d6f02-70f5-409a-b7fb-cd76733e77be req-69954b2d-7945-4f40-8631-0058baef2a99 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031040 Sep 09 06:33:29.697270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 267/545] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:29.799641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:29.800265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:29.806457 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:29.807024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:29.807462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:29.808175 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:29.808634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:29.809056 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:29.938452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:29.946785 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bbce99f1-963f-4f33-9dd2-fd8acf1b2a7b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.151179 Sep 09 06:33:29.947576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 279/546] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:29 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:30.024689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:30.025483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:30.032437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.033041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.033547 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:30.034321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.034854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.035352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:30.250954 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:30.259236 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0bae2029-42f1-4def-a93d-38a2fd2518fb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.238912 Sep 09 06:33:30.260068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 268/547] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:30 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:30.527362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:30.528198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:30.535073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.536852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.536852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:30.537220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.537672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.538109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:30.715016 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:30.717591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=100 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:30.726083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-68b40261-3de3-4203-a3f7-582da051a449 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.203657 Sep 09 06:33:30.727259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 280/548] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:30 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:30.969635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:30.970170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:30.977386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.977871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.978313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:30.978992 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:30.979447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:30.979898 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:31.110091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:31.118405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b816931e-ad19-4cea-9cd0-dd9fccb57780 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.152707 Sep 09 06:33:31.119016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 269/549] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:30 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:31.282537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:31.283070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:31.288982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:31.289462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:31.289890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:31.290568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:31.291021 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:31.291439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:31.417569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:31.425156 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cc391071-cc1f-415c-9666-90a35f2f90cb tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.146844 Sep 09 06:33:31.425725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 281/550] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:31 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:31.750259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:31.750864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:31.752811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:31.753616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=16 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:31.760264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:31.760750 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:31.761180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:31.762499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:31.762959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:31.763379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:31.899207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:31.907426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-79c2fcc5-348e-437d-8556-9f42091c15cb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.161112 Sep 09 06:33:31.908319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 270/551] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:31 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:32.141909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:32.142510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:32.144805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:32.150894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.151406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.151873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:32.152552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.153005 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.153424 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:32.290228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:32.298531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2e3cec86-011c-4ad2-be5d-607d08963122 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1679 microversion: 2.1 time: 0.160413 Sep 09 06:33:32.299100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 282/552] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:32 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:32.449338 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:32.449933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:32.456583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.457066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.457526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:32.458253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.458681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.459102 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:32.586697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:32.594455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3fb247ba-0032-495d-aad9-ee9cce96c10d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.149116 Sep 09 06:33:32.595027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 271/553] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:32 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:32.932168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:32.932777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:32.938720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.939197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.939655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:32.940335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:32.940788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:32.941208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.071375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:33.079420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0d2c0665-892e-4e4a-a6e1-84368dd06171 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.151604 Sep 09 06:33:33.080014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 283/554] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:32 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:33.322997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:33.323519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:33.329503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.329983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.330414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.331101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.331576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.332005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.462554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:33.470228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-089581c3-9d1b-4437-ae2d-1a5f5cfbd8c3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1656 microversion: 2.1 time: 0.151242 Sep 09 06:33:33.471695 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 272/555] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:33 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:33.493886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:33.500382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.500872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.501319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.526218 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Going to try to start instance {{(pid=120795) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 06:33:33.574948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a0b8fa6f-afb4-439a-9df9-3552271ec65b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action" status: 202 len: 0 microversion: 2.1 time: 0.084736 Sep 09 06:33:33.575711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 284/556] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:33:33 2022] POST /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:33.583778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:33.584393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:33.586285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:33.591447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.591969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.592424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.593095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.593550 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.594182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.619751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:33.620605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:33.627348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.627981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.628526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.629352 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.630050 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.630794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.845408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:33.854658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-da982735-7af2-4a0b-b817-99c406de561f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1665 microversion: 2.1 time: 0.274713 Sep 09 06:33:33.855352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 273/557] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:33 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1665 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:33.860072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3940b0da-abbf-4a9c-b3af-6ba131a360e7", "name": "network-vif-plugged", "status": "completed", "tag": "eb727d25-2aa3-45c0-9c74-3a14389a8bb3"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:33.870392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:33.871196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:33.871794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:33.884882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] Creating event network-vif-plugged:eb727d25-2aa3-45c0-9c74-3a14389a8bb3 for instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 on hv-cinder-85220 Sep 09 06:33:33.890408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-26e9e3b0-934f-461c-ad61-7f404d90cce9 req-17c59f85-33db-48ad-9fe2-6627a0baf5a4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Sep 09 06:33:33.891400 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 274/558] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:34.104355 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:34.105059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:34.111428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:34.111950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:34.112380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:34.113070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:34.113528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:34.114557 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:34.228742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:34.236187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1a7c264f-9e61-4be9-8e9d-b2bfd5864138 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.620894 Sep 09 06:33:34.236989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 285/559] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:33 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:34.391217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:34.399383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e2beed11-dbc6-410d-b231-e909174ab73f tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.299680 Sep 09 06:33:34.399978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 275/560] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:34 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:34.878111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:34.878721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:34.885248 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:34.885730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:34.886161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:34.886844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:34.887300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:34.887750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:35.020527 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:35.028192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d40eb41a-f837-45cd-90e4-c68b47770c93 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1665 microversion: 2.1 time: 0.153874 Sep 09 06:33:35.028765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 286/561] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:34 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:35.260089 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:35.260741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:35.266958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:35.267449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:35.268079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:35.268621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:35.269095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:35.269499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:35.404061 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:35.412333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-858e0861-f098-451b-b28d-cb922b07d058 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1318 microversion: 2.1 time: 0.156274 Sep 09 06:33:35.412890 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 276/562] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:35 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:35.422093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:35.422825 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:35.428977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:35.429469 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:35.429909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:35.430599 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:35.431058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:35.431489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:35.562978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:35.571722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-21315e33-39d2-4b6e-9eae-eedc348a27df tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.153440 Sep 09 06:33:35.572303 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 287/563] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:35 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:36.052749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:36.053363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:36.059272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.059789 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.060220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.060913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.061372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.061796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.200558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:36.208939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1237c7da-f263-41b0-b4dc-34308bb3b7ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1665 microversion: 2.1 time: 0.160151 Sep 09 06:33:36.209494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 277/564] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:36 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:36.434735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:36.435337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:36.442557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.443017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.443442 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.444254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.444705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.445130 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.573048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:36.580823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ea6cf52a-540e-4de7-854e-02aa4c412272 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1505 microversion: 2.1 time: 0.149908 Sep 09 06:33:36.581390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 288/565] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:36 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:36.594007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:36.594622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:36.601541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.602034 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.602470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.603163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.603642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.603765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b2fed0-e900-4d11-bf42-f5e7f6c7af0f", "device": "/dev/sdb"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:36.604068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.606263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:36.612423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.612903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.613331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.614587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:36.615037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:36.615456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:36.750323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:36.759799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a351f2b6-f3cb-4d86-9709-d6a65fa2703a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.169520 Sep 09 06:33:36.760360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 278/566] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:36 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:36.856669 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-093afc30-81e8-4a02-8c57-df7951bfebff tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "POST /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256626 Sep 09 06:33:36.857351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 289/567] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:33:36 2022] POST /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:33:37.232879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:37.233407 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:37.240248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:37.240695 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:37.241131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:37.241825 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:37.242284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:37.242711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:37.245435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:37.383134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:37.391149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bba1502b-2981-454a-8e22-106705205271 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1669 microversion: 2.1 time: 0.162122 Sep 09 06:33:37.391753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 279/568] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:37 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:37.784528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:37.785179 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:37.791585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:37.792070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:37.792495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:37.793171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:37.793622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:37.794039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:37.922198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:37.930837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1db2104e-6393-4edf-bff3-20c3ac6b2674 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.151123 Sep 09 06:33:37.931401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 290/569] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:37 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:38.954540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:38.955140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:38.962445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:38.962956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:38.963389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:38.964166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:38.964620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:38.965037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:39.100388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:39.108448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8a2c69e8-4bd2-4680-9eff-0125ee2f5178 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.157815 Sep 09 06:33:39.109013 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 280/570] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:38 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:40.132361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:40.132972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:40.139472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:40.139987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:40.140421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:40.141106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:40.141562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:40.141986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:40.270831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:40.278943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-72f029fc-cb91-4776-9218-e414480052b3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.151138 Sep 09 06:33:40.279507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 291/571] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:40 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:41.302927 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:41.303537 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:41.309956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:41.310439 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:41.310874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:41.311577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:41.312034 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:41.312457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:41.445006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:41.453170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3ff9835a-aea5-42d8-bcb6-2980de7aca7a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.154134 Sep 09 06:33:41.453741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 281/572] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:41 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:42.477898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:42.478439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:42.484901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:42.485381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:42.485803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:42.486478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:42.486928 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:42.487345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:42.618455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:42.626801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-51ad3fa6-0d67-45c7-a636-a6a2f333fb79 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.153695 Sep 09 06:33:42.627353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 292/573] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:42 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:43.014642 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:43.015180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:43.022751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.023241 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.023708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.024417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.024878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.025302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.056702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2278ca7e-743c-4c18-b725-dbfb6c04a8bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments/3c87aa82-151a-4201-a0b2-22eb642159c8" status: 200 len: 194 microversion: 2.20 time: 0.046013 Sep 09 06:33:43.057489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 282/574] 10.222.0.25 () {60 vars in 1454 bytes} [Fri Sep 9 06:33:43 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments/3c87aa82-151a-4201-a0b2-22eb642159c8 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:43.125295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:43.125845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:43.133020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.133503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.133929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.134607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.135056 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.135470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.260893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'services' on Instance uuid 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:43.375377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-40ad3f2b-63da-4ce1-ab37-fce86d1efd98 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments/3c87aa82-151a-4201-a0b2-22eb642159c8" status: 202 len: 0 microversion: 2.20 time: 0.253925 Sep 09 06:33:43.376019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 293/575] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Sep 9 06:33:43 2022] DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments/3c87aa82-151a-4201-a0b2-22eb642159c8 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:33:43.385249 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:43.387451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:43.393291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.393768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.394214 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.394880 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.395435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.395884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.425345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fcee75d1-8312-49b4-a768-70207e697d82 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043954 Sep 09 06:33:43.425896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 283/576] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:43 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:43.650876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:43.651585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:43.658340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.658821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.659250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.659966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:43.660419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:43.660859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:43.675893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:43.793699 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:43.802957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9ae45469-1637-4fce-86d7-e489f0fd7b64 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.156108 Sep 09 06:33:43.803533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 294/577] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:43 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:44.438480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:44.440748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:44.448463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:44.448956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:44.449379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:44.450059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:44.450512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:44.450930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:44.482424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f0a330d0-6fee-4573-abed-43eaa3a96032 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047850 Sep 09 06:33:44.487380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 284/578] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:44 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:44.826739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:44.827276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:44.833651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:44.834142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:44.834579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:44.835791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:44.836254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:44.836678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:44.967041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:44.976054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-179cda63-d818-484a-bf02-ad24efb20f86 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.152670 Sep 09 06:33:44.976625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 295/579] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:44 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:45.494599 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:45.496768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:45.503811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:45.503811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:45.504516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:45.504911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:45.505374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:45.505798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:45.537387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a0288303-3462-4f20-92ee-b64344884133 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046924 Sep 09 06:33:45.537937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 285/580] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:45 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:45.999256 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:45.999930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:46.006396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:46.007013 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:46.007451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:46.008161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:46.008620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:46.009042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:46.141346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:46.149401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-59f635ca-2984-4fb1-a1d5-93d2af36a0c5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.153965 Sep 09 06:33:46.149962 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 296/581] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:45 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:46.549841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:46.552072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:46.558444 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:46.558926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:46.559359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:46.560163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:46.560624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:46.561046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:46.590398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-93f21a9e-cf66-447f-a1e4-3e3cde781071 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Sep 09 06:33:46.590948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 286/582] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:46 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:47.173024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:47.173627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:47.180686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:47.181170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:47.181601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:47.182280 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:47.182734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:47.183154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:47.315095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:47.324249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f1fdcc42-c939-4cba-94de-bcbd7f56853a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.155054 Sep 09 06:33:47.324814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 297/583] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:47 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:47.603360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:47.605513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:47.611407 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:47.611925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:47.612360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:47.613048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:47.613506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:47.613931 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:47.643616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a10a5873-b806-43b8-9a40-8470d961af72 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044922 Sep 09 06:33:47.644174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 287/584] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:47 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:33:48.348129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:48.348811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:48.355672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.356164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.356597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.357285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.357763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.358184 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.491013 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:48.499228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-57ca800a-54dc-4703-a78b-cfd71d3f640b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.155291 Sep 09 06:33:48.499866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 298/585] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:48 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:48.656519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:48.658763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:48.665284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.665769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.666200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.666892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.667346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.667791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.700506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-43f27d0e-54a6-44dc-801e-2b06f9adfe6b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047869 Sep 09 06:33:48.701065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 288/586] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:33:48 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:48.767084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:48.767520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:48.776954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.777594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.778297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.780390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.780973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.781400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.809562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:33:48.886131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b5fe0420-2cf8-43f4-bbb7-1ff8cbff55aa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 204 len: 0 microversion: 2.20 time: 0.122663 Sep 09 06:33:48.886828 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 299/587] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 9 06:33:48 2022] DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 06:33:48.895168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:48.895948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:48.902253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.902743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.903179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:48.903906 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:48.904365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:48.904786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:49.032745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:49.041790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:49.043223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:49.044411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-63c68875-3d54-45ef-bec2-5e16e9c1a050 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.153269 Sep 09 06:33:49.044963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 289/588] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:48 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:33:49.523530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:49.524262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:49.530576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:49.531091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:49.531525 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:49.532260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:49.532717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:49.533167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:49.662290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:49.671111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3744ea05-fa20-4e10-8818-bbbfd7b6527b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.152636 Sep 09 06:33:49.671705 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 300/589] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:49 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:50.072442 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:50.072990 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:50.079508 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:50.080026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:50.080466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:50.081161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:50.081624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:50.082050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:50.212707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:50.220761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:50.222246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:50.223752 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c634c78e-c19a-4f07-b101-bb7b7b786f86 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.156097 Sep 09 06:33:50.224311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 290/590] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:50 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:50.694285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:50.695128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:50.701580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:50.702072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:50.702515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:50.703207 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:50.703699 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:50.704128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:50.834197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:50.843062 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-96171ac8-5761-4c15-a5d9-7b0355d6f429 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.152745 Sep 09 06:33:50.843659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:50 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:51.248784 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:51.249389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:51.255960 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:51.257031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:51.257462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:51.258141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:51.258593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:51.259012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:51.387340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:51.395405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:51.396871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:51.398987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-198a7093-1417-4077-810c-6d621bfaa71e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.154082 Sep 09 06:33:51.399570 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 291/592] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:51 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:51.867587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:51.868228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:51.874542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:51.875028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:51.875478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:51.876227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:51.876621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:51.877042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:52.006815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:52.014981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-92ca8348-91aa-43d4-a43b-7265b1960a1b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1736 microversion: 2.1 time: 0.151747 Sep 09 06:33:52.015564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 302/593] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:51 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:52.424230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:52.424817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:52.432637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:52.433121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:52.433551 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:52.434238 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:52.434692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:52.435112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:52.563390 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:52.572084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:52.573527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:52.574690 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-806b1c29-c6ea-49f2-99d3-47f536dca55b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.154331 Sep 09 06:33:52.575304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 292/594] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:52 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:53.037713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:53.038285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:53.044703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.045190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.045626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.046317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.046774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.047198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.247454 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:53.255707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9809096c-daa7-440e-a973-1802b8ae947d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1716 microversion: 2.1 time: 0.221911 Sep 09 06:33:53.256359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 303/595] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:53 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1716 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:53.376317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:53.376816 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:53.382782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.383273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.383754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.384456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.384921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.385348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.470650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] HTTP exception thrown: Cannot 'detach_volume' instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd while it is in vm_state rescued Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Request method failure captured: Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments/f7619c49-0d0f-44a8-8e05-cbd7120dc5e5 HTTP/1.1 Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1AGUILD7DmLsRt9aOu-ikMi1F0qGBHhXrTQ-5XEIwFapJRgo8vsHmPk_UHXcLVq0KtG6BGuztRCoJe4rfPIQIG3QNjuh6Yn3ENa8VU3hcBQ7GoOwtMQP0oWKFVFSy19m52T1JZd8PYkuYsKUYhlja-kZv6XszXUOaBOKyA5PZdxww Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:33:53.472296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 3e2bdc73390a43ff9eccc57948e2b4a6 Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:33:53.474160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Cannot 'detach_volume' instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd while it is in vm_state rescued Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'server_id': 'fc563f30-0bc9-4f2d-a07f-5c18471ec9fd', 'id': 'f7619c49-0d0f-44a8-8e05-cbd7120dc5e5'} Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:33:53.475117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd while it is in vm_state rescued Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd while it is in vm_state rescued Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:53.477251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Returning 409 to user: Cannot 'detach_volume' instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd while it is in vm_state rescued {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:33:53.478680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b1b44dda-4fb9-4cf9-b0f7-34157c2c75f6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments/f7619c49-0d0f-44a8-8e05-cbd7120dc5e5" status: 409 len: 152 microversion: 2.1 time: 0.101677 Sep 09 06:33:53.478680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 293/596] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:33:53 2022] DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments/f7619c49-0d0f-44a8-8e05-cbd7120dc5e5 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 06:33:53.483475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:53.484118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:53.490072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.490682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.491219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.491952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.492415 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.492841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.560874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e4fc81a2-5f9a-40d3-8432-8bfd227ed4dd tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/action" status: 202 len: 0 microversion: 2.1 time: 0.080787 Sep 09 06:33:53.564637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 304/597] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:33:53 2022] POST /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:53.574441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:53.575045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:53.581301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.581996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.582607 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.583310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.584011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.585307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.603498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:53.604252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:53.614370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.615221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.615723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.616781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:53.617246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:53.617676 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:53.956135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:53.965459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c0c141bd-4674-4672-8762-2567f5cb50d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1724 microversion: 2.1 time: 0.394774 Sep 09 06:33:53.966194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 294/598] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:53 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:53.982221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:54.001623 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:54.004726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:54.007479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8f81ba25-4e74-494c-83b9-6f2f36137e20 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1723 microversion: 2.20 time: 0.408946 Sep 09 06:33:54.008728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 305/599] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:53 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:54.530762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eaf1d52-f6aa-4028-ab06-e1efaefeec15", "name": "network-vif-deleted", "tag": "4814901d-9b66-4153-bf35-9750b3c3da8c"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:54.549548 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:54.549688 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:54.550003 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:54.563017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] Creating event network-vif-deleted:4814901d-9b66-4153-bf35-9750b3c3da8c for instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 on hv-cinder-85220 Sep 09 06:33:54.568843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-aba129b3-2d17-4286-8e6c-36e2aea144a8 req-9d27f9c9-41a8-4a46-a425-f380a12c2abe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041824 Sep 09 06:33:54.570080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 295/600] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:54.995693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:54.996238 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:54.998684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:55.003880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:55.004391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:55.004826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:55.005522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:55.005982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:55.007111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:55.049519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:55.050212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:55.056936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:55.057422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:55.057853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:55.058734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:55.059189 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:55.059634 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:55.076986 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:55.094800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:55.095288 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:55.095913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:55.096543 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'fault' on Instance uuid 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:55.149587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:55.160652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:55.162138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:55.164516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-11f296f3-6d7a-42e8-91be-23bbe2b51a0f tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1371 microversion: 2.20 time: 0.119175 Sep 09 06:33:55.172034 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 296/601] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:55 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:33:55.173807 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:55.183494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-85c63b8a-c9d1-4914-9bc6-78a3b2d2b302 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1724 microversion: 2.1 time: 0.191480 Sep 09 06:33:55.184310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 306/602] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:54 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:56.190258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:56.190870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:56.197867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.198348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.198781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.199465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.199966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.200390 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.206525 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:56.207122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:56.213709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.214197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.214631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.215319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.215792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.216215 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.232082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.232564 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.232991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.233430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'fault' on Instance uuid 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:56.284595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:56.292838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:56.294271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:56.295412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2a118bfe-802a-4f47-989a-2d234d788bb7 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1371 microversion: 2.20 time: 0.109042 Sep 09 06:33:56.295988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 297/603] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:56 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:56.300712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:56.301197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:56.307884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.308372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.308952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.309654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:56.310577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:56.310577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:56.372678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:56.380987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-145ee6b5-89ed-43aa-a207-4866a359ba01 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1724 microversion: 2.1 time: 0.178262 Sep 09 06:33:56.382121 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 307/604] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:56 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:33:56.392594 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lazy-loading 'services' on Instance uuid 3940b0da-abbf-4a9c-b3af-6ba131a360e7 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:56.463780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f77bbfb4-b595-475a-bed4-a75ebd5ab84c tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7/os-volume_attachments/29b2fed0-e900-4d11-bf42-f5e7f6c7af0f" status: 202 len: 0 microversion: 2.1 time: 0.166560 Sep 09 06:33:56.464374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 298/605] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:33:56 2022] DELETE /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7/os-volume_attachments/29b2fed0-e900-4d11-bf42-f5e7f6c7af0f => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:33:57.321753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:57.322350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:57.328738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.329225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.329651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.330328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.330781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.331193 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.346148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:33:57.366769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.367245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.367697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.368138 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'fault' on Instance uuid 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:33:57.406693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:57.407395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:57.416792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:57.426562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:57.428813 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.429394 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.429964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:57.430155 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.430885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.431372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.431817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.432001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1ec62c4a-4c40-4996-8ecb-6eea77662d28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 200 len: 1371 microversion: 2.20 time: 0.114341 Sep 09 06:33:57.432905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 308/606] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:57 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:33:57.578035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:57.586613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3787ae54-885d-4e8c-9390-9d1228e58ea9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1730 microversion: 2.1 time: 0.184053 Sep 09 06:33:57.587181 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 299/607] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:57 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:57.609518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:57.610029 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:57.616728 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.617279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.617711 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.618387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:57.618839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:57.619257 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:57.698736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1101d768-d7a1-442c-9b15-0122dbf1de31 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093038 Sep 09 06:33:57.699321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 309/608] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:33:57 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:33:58.458387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:58.458996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:58.465831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.466316 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.466747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.467442 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.467932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.468357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.482916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 HTTP/1.1 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:33:58.485204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:33:58.486957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '1eaf1d52-f6aa-4028-ab06-e1efaefeec15'} Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:33:58.487936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:33:58.489455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:33:58.490965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:33:58.490965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8054e9fc-b9f8-49a3-a4ae-ece7804b0274 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 404 len: 111 microversion: 2.20 time: 0.032229 Sep 09 06:33:58.490965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 300/609] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:33:58 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:33:58.497278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-910a874a-67fd-4708-891d-739105487e52 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '.version_select at 0x7f74ad0fc940>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:58.517106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-910a874a-67fd-4708-891d-739105487e52 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969809216" status: 204 len: 0 microversion: 2.20 time: 0.024933 Sep 09 06:33:58.517771 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 310/610] 10.222.0.25 () {60 vars in 1259 bytes} [Fri Sep 9 06:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969809216 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 06:33:58.671941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:58.672575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:58.682838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.686082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.686566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.687410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.690773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.690773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.720643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:33:58.810651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b62f6a25-cf99-4fe8-9d40-ff0905fb961d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 204 len: 0 microversion: 2.1 time: 0.151246 Sep 09 06:33:58.811903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 301/611] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:33:58 2022] DELETE /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:33:58.821063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:33:58.821668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:33:58.828850 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.829340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.829769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.830462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.831139 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.831561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.925165 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:58.935719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:33:58.936506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:33:58.937139 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:33:58.949391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] Creating event network-changed:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:33:58.954755 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-33ef6bda-6d57-4128-b299-9caebe4bd08d req-49b2d541-fb2f-4897-b717-2e79c4630c64 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033564 Sep 09 06:33:58.955838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 302/612] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:33:59.022600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:33:59.030972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f6ad7096-9fca-4c5b-b31c-1d6e7806c805 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1511 microversion: 2.1 time: 0.214418 Sep 09 06:33:59.035627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 311/613] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:33:58 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:33:59.274734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e456dbc1-964b-48e5-94be-f4c5879a2a54 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: .version_select at 0x7f74ad07f310>, body: {"keypair": {"name": "tempest-keypair-1456422382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQsB+JfIHK+wO0J+Mkp7DYn0XcMcFFvShXxwqS8jGvn3dCGCfDbLKLqpE5ibsHhLNORJgujc1feIzhj6hXbtQ9kvjtqx6FZ4FQjkeCAnND2ld/IAND76oalb/+H/fYqgA=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:33:59.295454 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-e456dbc1-964b-48e5-94be-f4c5879a2a54 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:33:59.299855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-e456dbc1-964b-48e5-94be-f4c5879a2a54 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for user 0a6757e5408e40cc85ad6145064d8ba7 and project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:33:59.330018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e456dbc1-964b-48e5-94be-f4c5879a2a54 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060294 Sep 09 06:33:59.330638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 303/614] 10.222.0.25 () {62 vars in 1200 bytes} [Fri Sep 9 06:33:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 06:34:00.054606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:00.055308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:00.061868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:00.062390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:00.062898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:00.063682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:00.064145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:00.064567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:00.277626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:00.285497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-60832342-4727-45c7-89a7-8c14e5ed5566 tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1511 microversion: 2.1 time: 0.235058 Sep 09 06:34:00.286155 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 312/615] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:00 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:00.915531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1041223720", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06aa4853-deab-4da2-aa65-5023553defd4"}], "security_groups": [{"name": "tempest-securitygroup--506864246"}], "key_name": "tempest-keypair-1456422382", "user_data": "}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:00.979827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:00.989025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:00.989506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:00.989933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:01.001282 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] Creating event network-changed:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:34:01.006723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-37ff29a8-5647-4fb8-a7d5-902fa699e0c8 req-019d68bf-6332-44c7-a2ab-966c4aaf21f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029978 Sep 09 06:34:01.007316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 313/616] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:01.136710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] validate_networks() for [('06aa4853-deab-4da2-aa65-5023553defd4', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:34:01.310643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:01.311343 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:01.317538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:01.318025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:01.319111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:01.319835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:01.320302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:01.320727 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:01.664934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:01.672670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4df503a0-0e28-435d-b889-415cab7a735d tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1511 microversion: 2.1 time: 0.366730 Sep 09 06:34:01.673252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 314/617] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:01 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:02.389490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:34:02.389975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:34:02.390410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:34:02.390822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:34:02.391237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:34:02.401240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:02.401861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:02.402571 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:02.403601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:02.404281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:02.404943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:02.424635 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:02.430403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Getting quotas for user 0a6757e5408e40cc85ad6145064d8ba7 and project 7d5de98a77f64cd5beeab6865f5ea7c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:02.442255 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:34:02.445588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:34:02.496085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-43731a30-4f30-48e3-a034-b2acdd48a0fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.585937 Sep 09 06:34:02.496903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 304/618] 10.222.0.25 () {62 vars in 1188 bytes} [Fri Sep 9 06:34:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 06:34:02.509539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:02.510840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:02.584614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:02.594650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:02.596757 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:02.598317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fb99ac3a-f083-4145-8546-ff1946fdf648 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1282 microversion: 2.20 time: 0.094097 Sep 09 06:34:02.599529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 315/619] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:02 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:02.696645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:02.697250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:02.699200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:02.705473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:02.705966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:02.706407 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:02.707110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:02.707780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:02.708213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:02.739970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:02.741067 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:02.741598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:02.741997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lazy-loading 'fault' on Instance uuid 3940b0da-abbf-4a9c-b3af-6ba131a360e7 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:02.788929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4659e9d9c65e436aa101db62a801a5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c96a5a4edc84b70a31c6b0cd2a8f864', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:02.797011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f8fc95cd-3efa-4ae9-910f-35b58a7f23af tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 200 len: 1308 microversion: 2.1 time: 0.104200 Sep 09 06:34:02.797577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 305/620] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:02 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:03.022723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3940b0da-abbf-4a9c-b3af-6ba131a360e7", "name": "network-vif-deleted", "tag": "eb727d25-2aa3-45c0-9c74-3a14389a8bb3"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:03.033272 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:03.033963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:03.034290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:03.046107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] Creating event network-vif-deleted:eb727d25-2aa3-45c0-9c74-3a14389a8bb3 for instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 on hv-cinder-85220 Sep 09 06:34:03.050858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-cacd94b5-05de-4fcb-beb2-ad219f99ed6b req-1d31398e-3322-4205-879f-cddaf2e36706 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Sep 09 06:34:03.051445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 316/621] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:03.625434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:03.626044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:03.633064 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:03.633575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:03.634010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:03.634699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:03.635158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:03.635640 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:03.701975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:03.710188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:03.711761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:03.712892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2adc3314-2c4c-4fe3-9829-c4dc584ac2da tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1334 microversion: 2.20 time: 0.091379 Sep 09 06:34:03.713440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 306/622] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:03 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:03.822500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:03.824370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] [instance: 3940b0da-abbf-4a9c-b3af-6ba131a360e7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:03.834149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:03.834692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:03.835120 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:03.835918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:03.836513 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:03.836943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:03.852471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] HTTP exception thrown: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Request method failure captured: Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 HTTP/1.1 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt2xhvaQLcmdSw1hkdAElRF7SLCWAYLqawXLU4pU7npRFftt0KuL6qh1IWKNpVmFksiSrqU-cG1rE4EipflWSiPuwbyM2jdL5ivOrHUMn78zKAw0RbwiOUVA9zYFnPcn9I69Z1zYH-tIWhcaI79laA_0YphuuqRM0ogrLAU3zUuXLDg Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 9c96a5a4edc84b70a31c6b0cd2a8f864 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:34:03.854122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9c96a5a4edc84b70a31c6b0cd2a8f864"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 9c96a5a4edc84b70a31c6b0cd2a8f864 Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1921450041 Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesSnapshotTestJSON-1921450041-project Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 4659e9d9c65e436aa101db62a801a5fe Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesSnapshotTestJSON-1921450041-project Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. Sep 09 06:34:03.855706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '3940b0da-abbf-4a9c-b3af-6ba131a360e7'} Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:03.856570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. Sep 09 06:34:03.857999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:03.859164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] Returning 404 to user: Instance 3940b0da-abbf-4a9c-b3af-6ba131a360e7 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:03.859164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d6ea8abc-df8e-4308-b35c-4f2fc4dafbed tempest-VolumesSnapshotTestJSON-1921450041 tempest-VolumesSnapshotTestJSON-1921450041-project] 10.222.0.25 "GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7" status: 404 len: 111 microversion: 2.1 time: 0.038821 Sep 09 06:34:03.859164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 317/623] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:03 2022] GET /compute/v2.1/servers/3940b0da-abbf-4a9c-b3af-6ba131a360e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:04.739087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:04.739899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:04.747840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:04.748328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:04.748757 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:04.749450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:04.749901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:04.750321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:04.957736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:04.965843 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:04.967921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:04.969052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-24715bec-8b34-4c4b-97d1-ac42cf43dd55 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.234006 Sep 09 06:34:04.969606 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 307/624] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:04 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:05.291586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:05.302400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:05.303156 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:05.303790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:05.315477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] Creating event network-changed:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:34:05.321561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-e5d5b635-b790-40e8-b5f1-da9736a0e1ff req-a80642db-4325-4172-b176-ac0a52ca961d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034761 Sep 09 06:34:05.322697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 318/625] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:05.994530 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:05.995138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:06.001799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:06.002295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:06.002726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:06.003422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:06.003925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:06.004351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:06.131588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:06.139528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:06.140995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:06.142097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-50be98d2-39d0-4bf7-827c-6e00021e147d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.151773 Sep 09 06:34:06.142652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 308/626] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:05 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:07.168466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:07.169157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:07.175259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:07.175779 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:07.176209 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:07.176891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:07.177349 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:07.177964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:07.308932 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:07.316976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:07.319075 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:07.320215 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f82dcb20-a0f7-4e24-a440-d1a7bdfd4193 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.156604 Sep 09 06:34:07.320773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 319/627] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:07 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:08.344722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:08.345593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:08.352494 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:08.352984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:08.353422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:08.354119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:08.354582 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:08.355009 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:08.488671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:08.497593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:08.499008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:08.500129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-736f9f99-d6be-4387-9428-0851a74ac499 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.159356 Sep 09 06:34:08.500681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 309/628] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:08 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:09.527001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:09.529993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:09.543580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:09.544531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:09.545859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:09.547207 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:09.547910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:09.548450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:09.784377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:09.793070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:09.794806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:09.796052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c239384b-c625-4cc6-9c66-238e73a944bf tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.274754 Sep 09 06:34:09.796706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 320/629] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:09 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:10.822159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:10.822804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:10.829152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:10.829631 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:10.830075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:10.830734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:10.831186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:10.831628 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:10.965363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:10.973459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:10.975031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:10.976144 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-049f143e-8649-4b5c-aa7f-392d98c27e1a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.158088 Sep 09 06:34:10.976935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 310/630] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:10 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:11.978181 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "name": "network-vif-plugged", "status": "completed", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:11.987986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:11.988473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:11.988906 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:12.000546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] Creating event network-vif-plugged:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:34:12.001096 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:12.001708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:12.005590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-11d568fa-075d-4a8d-8e30-c21b1e1d465b req-c0318b3a-a769-4f06-abe7-972a0dc17515 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Sep 09 06:34:12.006765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 321/631] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:12.008464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:12.008956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:12.009391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:12.010114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:12.010598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:12.011020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:12.149074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:12.157268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:12.158709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:12.159837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4c19fc38-f205-4173-82ea-9c58723fe435 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.163625 Sep 09 06:34:12.160756 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 311/632] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:11 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:13.181983 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:13.186660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:13.187347 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:13.194254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:13.194734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:13.195168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:13.195883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:13.196343 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:13.196763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:13.326647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:13.335130 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:13.336604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:13.337709 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8d06502e-a3e3-476f-8653-f0151dd29e9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.156723 Sep 09 06:34:13.342094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 322/633] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:13 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:14.362637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:14.363168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:14.365229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:14.366012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=10 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:14.372119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.372607 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.373041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.373730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.374194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.374622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.506002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:14.508403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:14.515333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:14.516826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:14.517967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2d8460f7-d123-49ff-9028-be1a793da444 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.159361 Sep 09 06:34:14.518526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 312/634] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:14 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:14.641328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:14.641816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:14.648586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.649064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.649494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.650168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.650618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.651033 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.675204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:34:14.747246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4a4dd1ac-42e0-45c2-9896-ccd74456ec47 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 204 len: 0 microversion: 2.1 time: 0.109412 Sep 09 06:34:14.747869 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 323/635] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:34:14 2022] DELETE /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:34:14.757001 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:14.757604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:14.765110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.765595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.766024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.766726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:14.767180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:14.767639 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:14.896967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:14.904718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7c00969b-7303-4956-b367-6f233670ba59 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1579 microversion: 2.1 time: 0.152622 Sep 09 06:34:14.905284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 313/636] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:14 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:15.546322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:15.547741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:15.557219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:15.557712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:15.558151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:15.558853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:15.559308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:15.559767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:15.703355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:15.711587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:15.713035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:15.714134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-509ff89e-7311-4cea-94b0-4b036b951753 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.174066 Sep 09 06:34:15.714689 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 324/637] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:15 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:15.929779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:15.930389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:15.936707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:15.937190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:15.937621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:15.938393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:15.938858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:15.939278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:16.070229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:16.077848 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-af9b33be-320a-4c2c-9efc-bb9d4c9eb721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1579 microversion: 2.1 time: 0.152642 Sep 09 06:34:16.078412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 314/638] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:15 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:16.738127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:16.738732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:16.746001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:16.746485 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:16.746915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:16.747633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:16.748090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:16.748511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:16.876240 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:16.884426 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:16.885850 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:16.887064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-435ab5e7-65ee-4116-ae0e-3cbef5281f28 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1407 microversion: 2.20 time: 0.152893 Sep 09 06:34:16.887650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 325/639] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:16 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:17.102156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:17.102728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:17.108578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.109063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.109504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:17.110190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.110647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.111071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:17.173071 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:17.173686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:17.180400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.180896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.181328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:17.182029 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.182542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.182968 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:17.206904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-20722f42-b6b0-4f4d-880e-c22e2d549bf7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/ips" status: 200 len: 150 microversion: 2.1 time: 0.037836 Sep 09 06:34:17.207482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 326/640] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:34:17 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:17.245521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:17.253357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e559e17f-c0e0-49b7-ab4a-393af54e8f07 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1579 microversion: 2.1 time: 0.155325 Sep 09 06:34:17.253929 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 315/641] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:17 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:17.913118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:17.913809 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:17.920324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.920761 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.921196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:17.921892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:17.922350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:17.922774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.062905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:18.071339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:18.072873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:18.074026 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e082f047-ccf9-4f6f-8fbc-5789b8185421 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1598 microversion: 2.20 time: 0.165544 Sep 09 06:34:18.074585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 327/642] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:17 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:18.101281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:18.101775 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:18.108371 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.108959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.109269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.109963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.110427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.110845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.193416 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3f0bf418-08fa-46fe-a632-24e8daf8ebfc tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096862 Sep 09 06:34:18.194288 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 316/643] 10.222.0.25 () {60 vars in 1316 bytes} [Fri Sep 9 06:34:18 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 06:34:18.277488 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:18.278133 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:18.284017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.284507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.284943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.285634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.286095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.286575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.528591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:18.537821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c55564b0-b845-4fd8-a501-c5d34d136efe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1579 microversion: 2.1 time: 0.263839 Sep 09 06:34:18.538664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 328/644] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:18 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1579 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:18.542649 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ae0128f-f459-4fcf-a25d-8781afae7b7d"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:18.545701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:18.552524 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.553021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.553466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.554441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:18.555172 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:18.555894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:18.973454 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8635de8a-8d6f-4097-882f-c49f26c63a21 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435323 Sep 09 06:34:18.974740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 317/645] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:34:18 2022] POST /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:19.572912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:19.573727 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:19.582027 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:19.582610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:19.583052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:19.584003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:19.584592 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:19.585060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:19.589667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:19.823389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:19.835163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:19.835673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:19.836105 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:19.849399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] Creating event network-changed:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:34:19.855062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-8eb800f3-c8bb-4545-af2e-c80ea8d061f4 req-14e9c975-3bfe-4d55-a856-03befc26b2c7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038291 Sep 09 06:34:19.856622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 318/646] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:19.862063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:19.871108 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b5c792c4-374f-4d4c-88fc-d11318599f7f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1579 microversion: 2.1 time: 0.308110 Sep 09 06:34:19.872084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 329/647] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:19 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1579 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:20.894678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:20.895438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:20.909811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:20.910467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:20.911175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:20.912299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:20.912889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:20.913317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:20.979994 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:20.987714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3e9ac783-2656-41d5-8f1a-06796663ae43 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 200 len: 1226 microversion: 2.1 time: 0.097248 Sep 09 06:34:20.988289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 319/648] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:20 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:21.904478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be567a31-4455-4dc6-8be1-937ae81a8dbb", "name": "network-vif-deleted", "tag": "1b544ee4-2fba-476c-b109-803fa6e71594"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:21.916064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:21.916555 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:21.917018 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:21.929079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] Creating event network-vif-deleted:1b544ee4-2fba-476c-b109-803fa6e71594 for instance be567a31-4455-4dc6-8be1-937ae81a8dbb on hv-cinder-85220 Sep 09 06:34:21.933898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-5f8dfa52-6ea6-48e9-998e-f9a67f76c451 req-751f2a88-282a-47d7-a7c2-70264f259b6d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033291 Sep 09 06:34:21.934501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 330/649] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:22.011106 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:22.011835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:22.018115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:22.018602 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:22.019031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:22.019738 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:22.020192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:22.020612 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:22.035041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] HTTP exception thrown: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Request method failure captured: Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb HTTP/1.1 Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt2IOwqgpRP4wCTOGHjzuatqxiUXtq3ZLBZCMsBm0jWW1xejAfkoR1kJnUOdzMgEiiLZ6JoHah8D8jnKXlpPoCFy1l8pKsupTtr_uyAgRsBBzFtUQNjKXAxFyeLfK3mODX61vCBAQowI0wQkYMvw7rvlX6cL4gXReSbMDteGICR_Kxo Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:34:22.037193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 472b6623f57a41568fe7ffce8e40e350 Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:34:22.038838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'be567a31-4455-4dc6-8be1-937ae81a8dbb'} Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:22.039952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:34:22.041373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:22.042659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Returning 404 to user: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:22.042659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c6d78a26-86a5-4b4c-8402-575cda8f752d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 404 len: 111 microversion: 2.1 time: 0.031434 Sep 09 06:34:22.042659 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 320/650] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:22 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:22.138200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1356982912", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2075716063", "security_groups": [{"name": "tempest-secgroup-smoke-959218854"}], "block_device_mapping_v2": [{"uuid": "7ac16319-6dd4-435e-bd3a-9ccd1651b45e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7964840-3c67-4db0-a5fd-d0b8ff555b07"}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:22.256767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] validate_networks() for [('a7964840-3c67-4db0-a5fd-d0b8ff555b07', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:34:22.633706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:34:22.634114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:34:22.634588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:34:22.634988 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:34:22.635396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:34:22.644478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:22.644959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:22.645388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:22.646363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:22.646976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:22.647402 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:22.664578 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:22.669233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for user 472b6623f57a41568fe7ffce8e40e350 and project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:22.730086 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:34:22.732335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ac16319-6dd4-435e-bd3a-9ccd1651b45e',volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:34:23.056989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [da919729-12c1-4604-8353-80bb39704bb8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 06:34:24.064653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [da919729-12c1-4604-8353-80bb39704bb8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59420. Sep 09 06:34:24.070402 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5d7d62df-a45f-4666-8704-b4b1c39a792c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.936521 Sep 09 06:34:24.076037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 331/651] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:34:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:34:24.083648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-267dd17a-37d3-4d07-aea1-be80516fb963 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:24.084269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-267dd17a-37d3-4d07-aea1-be80516fb963 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:24.144278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-267dd17a-37d3-4d07-aea1-be80516fb963 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:24.152357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-267dd17a-37d3-4d07-aea1-be80516fb963 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1095 microversion: 2.1 time: 0.073650 Sep 09 06:34:24.153858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 321/652] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:24 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:25.177198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:25.177959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:25.180108 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:25.186134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:25.186632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:25.187060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:25.187766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:25.188217 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:25.188634 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:25.253377 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:25.261766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-51916c51-02cd-4c1c-a5a4-aefff9ad37bd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1193 microversion: 2.1 time: 0.089097 Sep 09 06:34:25.262354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 332/653] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:25 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:26.285669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:26.287242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:26.295007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.295492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.296248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.296941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.297553 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.298143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.508196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:26.518090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-16f82eb8-0ef7-4b55-9558-16042e2c393e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1211 microversion: 2.1 time: 0.235807 Sep 09 06:34:26.531567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 322/654] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:26 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:26.574793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ae0128f-f459-4fcf-a25d-8781afae7b7d"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:26.577267 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:26.583910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.585067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.585542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.586642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.587228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.587780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.677258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: POST /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments HTTP/1.1 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 74 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:34:26.680530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {"volumeAttachment": {"volumeId": "1ae0128f-f459-4fcf-a25d-8781afae7b7d"}} Sep 09 06:34:26.682279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'server_id': '9c7eb260-2b49-4a8f-bf7b-6098b136a4bb', 'body': {'volumeAttachment': {'volumeId': '1ae0128f-f459-4fcf-a25d-8781afae7b7d'}}} Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:26.683270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:26.684813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 400 to user: Invalid volume: volume 1ae0128f-f459-4fcf-a25d-8781afae7b7d is already attached to instances: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a54fd5fe-ff95-4a23-9adf-1eb07cf6bcbc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112519 Sep 09 06:34:26.686381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 333/655] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:34:26 2022] POST /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:34:26.755305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:26.756655 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:26.765472 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.766135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.766866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.767763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:26.768375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:26.768951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:26.884017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'services' on Instance uuid 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:26.994753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4b1d585c-5c3d-4b89-a879-8b6e9ed9c7b5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments/1ae0128f-f459-4fcf-a25d-8781afae7b7d" status: 202 len: 0 microversion: 2.1 time: 0.245666 Sep 09 06:34:26.995516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 323/656] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:34:26 2022] DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments/1ae0128f-f459-4fcf-a25d-8781afae7b7d => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:34:27.004370 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:27.007957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:27.017101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:27.017603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:27.018048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:27.018766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:27.019231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:27.019691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:27.063686 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1950b4d6-ff01-4529-98ce-66ed4710c6a7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063548 Sep 09 06:34:27.068756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 334/657] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:26 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:27.546295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:27.547773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:27.557485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:27.558321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:27.559117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:27.560208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:27.565207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:27.565946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.076994 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:28.079626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:28.087286 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.087925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.088357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.089083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.089531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.089948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.122752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c57fe4e8-afba-41e8-b8c0-81b0be372b6b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050174 Sep 09 06:34:28.123353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 335/658] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:28 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 06:34:28.135310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:28.143783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b0c86d16-bb61-4213-abdc-25963b2bf2b0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.602296 Sep 09 06:34:28.144686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 324/659] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:27 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:28.203328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:28.203845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:28.210176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.210665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.211100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.211810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.212278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.212697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.238443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:34:28.324417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de17e99-45f8-4fdc-8e35-f0f38d6737f8", "tag": "3690fe7c-0bd9-4039-a5dd-e333a1aaefe2"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:28.338607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ab834c2f-74ee-437a-a456-8d90236aa2af tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 204 len: 0 microversion: 2.1 time: 0.138812 Sep 09 06:34:28.339581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 336/660] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:34:28 2022] DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:34:28.348057 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:28.356856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.358452 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.360338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:28.361140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.367453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.368001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.368536 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.370027 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:28.370502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:28.370973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:28.379951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] Creating event network-changed:3690fe7c-0bd9-4039-a5dd-e333a1aaefe2 for instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 on hv-cinder-85220 Sep 09 06:34:28.385668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-4f455b90-a6a3-4dfa-8159-c367a603b1bd req-85eef645-f0f4-4554-9cdb-d050c0225916 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066530 Sep 09 06:34:28.386761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 325/661] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:28.623776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:28.632818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fe852d33-024f-45db-887d-7fabd71dc681 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1681 microversion: 2.1 time: 0.289231 Sep 09 06:34:28.639595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 337/662] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:28 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:29.167675 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:29.168380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:29.174707 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:29.175202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:29.175666 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:29.176365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:29.177346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:29.177865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:29.323849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:29.331474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6e1186fc-1e9a-4d6a-a953-3cfbeab33086 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.168820 Sep 09 06:34:29.332072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 326/663] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:29 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:29.656875 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:29.657462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:29.664819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:29.665305 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:29.665739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:29.666423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:29.666872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:29.667288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:30.082799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:30.091914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2ae89cf5-b1c4-4fb6-b1f6-68df0b69ea7b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1681 microversion: 2.1 time: 0.438787 Sep 09 06:34:30.092497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 338/664] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:29 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1681 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:30.355121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:30.355761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:30.362923 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:30.363643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:30.364171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:30.364985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:30.365575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:30.366233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:30.579726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:30.587782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-41ff70bd-b400-412a-a875-6adc44a59175 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.236403 Sep 09 06:34:30.588427 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 327/665] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:30 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:31.116636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:31.117271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:31.124161 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:31.124657 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:31.125172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:31.125819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:31.126281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:31.126710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:31.245985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:31.253630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bd7d6e23-c48a-4451-97ba-4ee05aa74fa7 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1614 microversion: 2.1 time: 0.141070 Sep 09 06:34:31.254200 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 339/666] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:31 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1614 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:31.552127 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7eb260-2b49-4a8f-bf7b-6098b136a4bb", "name": "network-vif-deleted", "tag": "abab4c35-0202-452b-9ab3-3bda90e50057"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:31.583398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:31.586124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:31.586830 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:31.618506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:31.622803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:31.633866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] Creating event network-vif-deleted:abab4c35-0202-452b-9ab3-3bda90e50057 for instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb on hv-cinder-85220 Sep 09 06:34:31.635292 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:31.636010 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:31.636606 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:31.637631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:31.638266 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:31.638851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:31.644358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-641e1bf1-5c08-4f67-882d-326b8ff88784 req-e15efea7-1dd5-4ae1-86a2-a54b397e9c8a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103690 Sep 09 06:34:31.644982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 328/667] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:31.798631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:31.808793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-39a27041-d39f-455e-a575-c1126a15bfef tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.201342 Sep 09 06:34:31.809696 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 340/668] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:31 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:32.278743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:32.279450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:32.285613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:32.286298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:32.286846 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:32.287633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:32.288478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:32.290049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:32.322972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:32.323460 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:32.323918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:32.324362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:32.367638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:32.375432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-52ad3c51-feb6-4b09-9b7b-0d8ac1756dcc tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1331 microversion: 2.1 time: 0.100902 Sep 09 06:34:32.376046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 329/669] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:32 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:32.833883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:32.834418 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:32.836834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:32.837531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=6 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:32.843645 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:32.844144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:32.844582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:32.845274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:32.845736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:32.846162 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:32.979357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:32.986905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-63b86747-9a76-4095-adb1-df3c29e2c0fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.157134 Sep 09 06:34:32.987476 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 341/670] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:32 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:33.398779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:33.399381 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:33.401772 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=56 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:33.406846 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:33.407325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:33.407781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:33.408464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:33.408916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:33.409333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:33.441661 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:33.442246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:33.442769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:33.443209 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:33.483928 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:33.486057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:33.493229 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b4118ec8-8f6e-49f0-a3d3-052286c8bbb2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1331 microversion: 2.1 time: 0.098419 Sep 09 06:34:33.493809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 330/671] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:33 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:34.010989 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:34.011535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:34.018017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:34.018499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:34.018934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:34.019654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:34.020805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:34.021220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:34.152132 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:34.159789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7db33589-abab-4637-8beb-dcc1ae51e461 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.152718 Sep 09 06:34:34.160358 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 342/672] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:34 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:34.517145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:34.517754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:34.519512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:34.526505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:34.526997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:34.527430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:34.528158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:34.528614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:34.529037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:34.560657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:34.561142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:34.561575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:34.562019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:34.606221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:34.614334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a8b09996-98c3-4381-841d-c7c610bd4424 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 200 len: 1331 microversion: 2.1 time: 0.101527 Sep 09 06:34:34.614901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 331/673] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:34 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:35.182806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:35.183421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:35.190067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:35.190569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:35.190998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:35.191938 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:35.192451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:35.192934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:35.324058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:35.331774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b9a6c6ef-a698-4c93-a557-b2ebf36f5c5f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.152773 Sep 09 06:34:35.332345 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 343/674] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:35 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:35.636747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:35.637354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:35.643805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:35.644272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:35.644704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:35.645586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:35.646154 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:35.646580 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:35.659409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb HTTP/1.1 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:34:35.661854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:34:35.663500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '9c7eb260-2b49-4a8f-bf7b-6098b136a4bb'} Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:35.664473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:34:35.666046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:34:35.667357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:35.667357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2e594636-6322-4ad3-8f90-fb2026b3207d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 404 len: 111 microversion: 2.1 time: 0.030427 Sep 09 06:34:35.667357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 332/675] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:35 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:35.672036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e67cde9f-26ea-4cd8-b290-1dd4810a51d9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '.version_select at 0x7f74acef09d0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:35.690595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e67cde9f-26ea-4cd8-b290-1dd4810a51d9 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113541636" status: 202 len: 0 microversion: 2.1 time: 0.022352 Sep 09 06:34:35.691145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 344/676] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 9 06:34:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113541636 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 06:34:36.314149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-75b87234-2330-400b-a5bf-0ac2b287fba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: .version_select at 0x7f74ad131dc0>, body: {"keypair": {"name": "tempest-keypair-858328277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpaVXCo+BY0tB2/a/kFqz9gKmJABK9BNI9eslJc6fz1vpfG7cc2aW/2+P0MoUmDw8SBmzL03VSgkV0oQZ6vWiP4hPfDHI0oqXRwzSh1t2sG5zkIQphxEqRjj3to1HHs1g=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:36.330142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-75b87234-2330-400b-a5bf-0ac2b287fba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:36.333906 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-75b87234-2330-400b-a5bf-0ac2b287fba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:36.355642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:36.356201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-75b87234-2330-400b-a5bf-0ac2b287fba0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045657 Sep 09 06:34:36.356316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:36.356550 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 333/677] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:34:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:36.367140 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:36.367664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:36.368098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:36.368799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:36.369258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:36.369708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:36.528354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:36.536886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-83e73e36-08df-455f-8588-321790f249ec tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.185760 Sep 09 06:34:36.537529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 345/678] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:36 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:37.561053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:37.561622 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:37.576975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:37.577600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:37.578310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:37.580078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:37.580996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:37.583115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:37.663257 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1015342430", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a1e56b2-5174-4859-ad55-8ae965984c50"}], "security_groups": [{"name": "tempest-securitygroup--165081567"}], "key_name": "tempest-keypair-858328277", "user_data": "}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:37.740924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:37.753231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c5ae9073-698a-41c6-b7e0-54ee46190e1d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.196382 Sep 09 06:34:37.763776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 334/679] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:37 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:37.797030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] validate_networks() for [('6a1e56b2-5174-4859-ad55-8ae965984c50', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:34:38.519384 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:34:38.519876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:34:38.520382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:34:38.520790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:34:38.521203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:34:38.529993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:38.530479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:38.530911 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:38.531676 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:38.532141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:38.532573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:38.549697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:38.554690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Getting quotas for user 925d5f23bd3f4b35a66736d2a6a3c3eb and project e8ee1a9407994bf9a624e6231c7fe565. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:38.565894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:34:38.568400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:34:38.617831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7edc84ee-58c5-4e29-9a7b-a811ac96491f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.959518 Sep 09 06:34:38.618474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 346/680] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:34:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 06:34:38.629601 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0ce57c9b-90b1-4372-9939-04c2f9a3327e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:38.630593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0ce57c9b-90b1-4372-9939-04c2f9a3327e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:38.691755 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ce57c9b-90b1-4372-9939-04c2f9a3327e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:38.699883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0ce57c9b-90b1-4372-9939-04c2f9a3327e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1241 microversion: 2.1 time: 0.074107 Sep 09 06:34:38.700799 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 335/681] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:38 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:38.777236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:38.777889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:38.783926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:38.784413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:38.784848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:38.786069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:38.786534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:38.786957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:38.791699 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:38.919519 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:38.928549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d0eafeab-4099-44fe-8147-b7feb2a59edf tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.155545 Sep 09 06:34:38.929197 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 347/682] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:38 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:39.722560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:39.723941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:39.733615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.734115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.734559 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:39.735261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.735763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.736567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:39.799120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:39.806718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-82dca727-4871-45fd-a4bd-329834b4f8ff tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1293 microversion: 2.1 time: 0.088338 Sep 09 06:34:39.807281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 336/683] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:39 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:39.951112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:39.951742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:39.953824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:39.954717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:39.959123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.959877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.960497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:39.961215 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.961838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.962427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:39.964892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.965387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.965822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:39.967370 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:39.967863 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:39.968684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.071817 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'services' on Instance uuid fc563f30-0bc9-4f2d-a07f-5c18471ec9fd {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:40.168325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9d05c90a-a691-415f-8d42-0b98ca257fe3 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments/f7619c49-0d0f-44a8-8e05-cbd7120dc5e5" status: 202 len: 0 microversion: 2.1 time: 0.221177 Sep 09 06:34:40.169248 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 348/684] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:34:39 2022] DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments/f7619c49-0d0f-44a8-8e05-cbd7120dc5e5 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:34:40.178922 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:40.182698 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:40.189881 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.190374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.190814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.191516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.192529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.192956 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.206820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:40.218885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-feb464f6-3a00-424d-8334-2e254ea1b8ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.270813 Sep 09 06:34:40.219473 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 337/685] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:39 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:40.234814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4c4f9d7a-b10b-4435-8418-a3cd4e7abaad tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060839 Sep 09 06:34:40.239588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 349/686] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:40 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:40.802899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:40.805290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:40.813512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.814429 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.815017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.816069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.816426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.817499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.829158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:40.829767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:40.836054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.836545 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.836978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.838334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.838334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.838738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.855600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fc92fd05-447a-43b8-9b5a-f3897c902a35 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056638 Sep 09 06:34:40.865861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 338/687] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:40 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:34:40.941319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:40.942487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:40.948719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.949213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.949646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.950398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:40.950855 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:40.951273 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:40.981939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:34:41.085615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-826b088c-222f-4fe4-814c-3f1cf22a4420 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 204 len: 0 microversion: 2.1 time: 0.147738 Sep 09 06:34:41.086483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 339/688] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:34:40 2022] DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 06:34:41.095243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:41.096103 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:41.103195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.103859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.104409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.105210 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.105763 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.106282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.115394 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:41.130008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3935358a-826a-42de-9dd3-aa8bab5f58df tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.303903 Sep 09 06:34:41.130653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 350/689] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:40 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:41.244602 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:41.245211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:41.251557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.252058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.252487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.253169 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.253622 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.254038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.383051 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:41.390812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e0499086-7305-435c-8436-5dbe8af07eac tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1675 microversion: 2.1 time: 0.299722 Sep 09 06:34:41.391385 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 340/690] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:41 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1675 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:41.407329 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:41.409696 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:41.416442 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.416935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.417375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.418149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.418519 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.418951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.451319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2c2d9e3f-2337-403d-a47d-7d78100918d5 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058850 Sep 09 06:34:41.451938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 341/691] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:41 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:41.526901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:41.534961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fde1b471-8b99-4dd8-b4c4-2dfaf76e9ecd tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.294175 Sep 09 06:34:41.536097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 351/692] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:41 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:41.899728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12b4fc4-0305-4f63-94a7-5065cbcb0131", "tag": "5b26d108-0a54-4684-a651-7c4059439a0e"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:41.909264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:41.909746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:41.910211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:41.921368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] Creating event network-changed:5b26d108-0a54-4684-a651-7c4059439a0e for instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 on hv-cinder-85220 Sep 09 06:34:41.925930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-5e092853-6f7c-4e72-b995-f99f57ee67ef req-5b7b60c7-1e81-470b-b4ca-1d6d2249bd79 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030242 Sep 09 06:34:41.927684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 342/693] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:42.124785 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de17e99-45f8-4fdc-8e35-f0f38d6737f8", "name": "network-vif-plugged", "status": "completed", "tag": "3690fe7c-0bd9-4039-a5dd-e333a1aaefe2"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:42.135683 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.136174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.136799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.148575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] Creating event network-vif-plugged:3690fe7c-0bd9-4039-a5dd-e333a1aaefe2 for instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 on hv-cinder-85220 Sep 09 06:34:42.153413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-62b519bb-51af-4bd5-92e1-8122742b05c8 req-4ca7e33b-0255-47b8-8046-aa5cf8f6d6f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Sep 09 06:34:42.154242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 352/694] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:42.155069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:42.155810 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:42.162612 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.163200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.163665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.164445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.164924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.165450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.298613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:42.307527 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-93a45631-bf00-41e5-a5c4-c9f5d71ed8ef tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.156969 Sep 09 06:34:42.308129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 343/695] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:42 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:42.414385 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:42.415113 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:42.421187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.421678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.422116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.422796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.423268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.423712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.463928 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:42.465991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:42.471907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.472673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.473793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.474684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.475146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.475597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.507318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b60ae2d9-bac5-44f4-b568-83465be2d640 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Sep 09 06:34:42.507920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 344/696] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:42 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:42.557461 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:42.558223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:42.558837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:42.564765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.565172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-347dd3d4-fc6d-49b9-864b-73f53f6ce4de tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1675 microversion: 2.1 time: 0.155544 Sep 09 06:34:42.565271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.565667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.568751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 353/697] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:42 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:42.568922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:42.568922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:42.568922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:42.701694 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:42.710217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5ae0e3c1-ddd6-4178-bbc9-7eaef4137a84 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.155743 Sep 09 06:34:42.710883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 345/698] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:42 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:43.330297 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:43.330935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:43.337495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.337984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.338419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.339110 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.339593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.340017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.519525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:43.521885 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:43.528386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.528881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.529316 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.530021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.530510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.530936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.563680 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6d651894-cb28-407a-aeef-a9694ed18189 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048031 Sep 09 06:34:43.570197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 346/699] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:34:43 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 06:34:43.588197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:43.589069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:43.597964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.598465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.599172 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.599827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.600462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.601074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.797206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:43.806768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-10780ef2-d1e0-4f3b-9b45-8dcdc7141f13 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.480146 Sep 09 06:34:43.807243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 354/700] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:43 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:43.827823 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:43.828619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:43.835066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.835574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.836030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.836715 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.837171 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.837605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.865707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:34:43.943506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b23ea743-fb12-4649-8a20-2fc079faa77d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 204 len: 0 microversion: 2.1 time: 0.119755 Sep 09 06:34:43.944325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 355/701] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:34:43 2022] DELETE /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:34:43.951520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:43.952472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:43.959318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.959842 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.960285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.961154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:43.961619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:43.962045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:43.996834 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:44.004996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-17691b9f-0377-4a3f-9743-7fa17f80d09e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1675 microversion: 2.1 time: 0.420882 Sep 09 06:34:44.005735 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 347/702] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:43 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1675 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:44.016548 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:44.017302 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:44.023477 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:44.024146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:44.024684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:44.025496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:44.026074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:44.026506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:44.272919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:44.281414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-17d75c97-5421-4f43-b2c7-32263ef29182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.335717 Sep 09 06:34:44.282084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 356/703] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:43 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:44.334995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:44.337321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:44.343904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c2f83bfe-93e3-43fd-adbe-69a83b288adf tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1690 microversion: 2.1 time: 0.331139 Sep 09 06:34:44.344480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 348/704] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:44 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1690 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:44.830486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:44.831093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:44.837990 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:44.838488 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:44.838920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:44.839901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:44.840635 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:44.841131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.028806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:45.029696 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:45.039260 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.040329 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.040673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.041381 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.041841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.042334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.127074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:45.135408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-83b8e3c0-cacc-41d8-b9b7-495b27701166 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1607 microversion: 2.1 time: 0.110421 Sep 09 06:34:45.136023 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 349/705] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:45 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:45.141157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebebb1d1-2de0-4afb-b816-797f5a4ed1ff", "name": "network-vif-deleted", "tag": "2f4a6eb7-079c-4c01-b074-3e7a050153a9"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:45.151417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.152152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.152759 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.165537 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] Creating event network-vif-deleted:2f4a6eb7-079c-4c01-b074-3e7a050153a9 for instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff on hv-cinder-85220 Sep 09 06:34:45.170922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-8019ac4a-865c-496f-b4bf-b6934cc274d2 req-87bb13dd-14d2-4975-bde5-2d505402089f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033213 Sep 09 06:34:45.171423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 350/706] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:45.199516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:45.207788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e3ceeda3-38e4-43b0-9415-3e17bfb541f8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.380628 Sep 09 06:34:45.208386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 357/707] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:44 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:45.305041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:45.305746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:45.311819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.312310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.312754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.313447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.313909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.314333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.367933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:45.369614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:45.375025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.375524 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.376762 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.377474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:45.377941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:45.379600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:45.486030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:45.495085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f9c18360-3261-420f-b75f-fd12b974ed4f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.194318 Sep 09 06:34:45.495826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 351/708] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:45 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:45.549535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:45.572569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-83ac0ed8-e126-46d6-a355-597c842945de tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1690 microversion: 2.1 time: 0.208421 Sep 09 06:34:45.573186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 358/709] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:45 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:46.159604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:46.160866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:46.167485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.168010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.168449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.169150 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.169614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.170084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.230250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:46.230940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:46.232997 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:46.237356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.237845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.238278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.239592 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.240097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.240539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.241554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c6df97ab-9982-4850-98af-622e0ac5eee5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1607 microversion: 2.1 time: 0.085826 Sep 09 06:34:46.242128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 352/710] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:46 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1607 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:46.368856 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:46.376434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5aab4c71-860d-4f20-bb2d-f24db717777e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.150074 Sep 09 06:34:46.377005 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 359/711] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:46 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:46.519124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:46.520221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:46.526138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.526620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.527050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.527765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.528228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.528648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.595844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:46.596451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:46.603972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.604457 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.604885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.605567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:46.606019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:46.606434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:46.694281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:46.701874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bc5bbe7c-c2c4-4817-a0ad-56d0b994b90f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.186645 Sep 09 06:34:46.702831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 353/712] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:46 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:46.755617 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:46.763153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bf4ec7fb-d554-4d7e-a2f6-78b941cca4e6 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1690 microversion: 2.1 time: 0.171259 Sep 09 06:34:46.763740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 360/713] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:46 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:47.263925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:47.264539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:47.271831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.272320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.272758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.273458 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.273922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.274350 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.342217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:47.351200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-896254d7-ccb3-4715-a95e-8ae980629911 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1607 microversion: 2.1 time: 0.091213 Sep 09 06:34:47.351793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 354/714] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:47 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:47.398654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:47.399398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:47.406094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.406578 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.407012 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.407743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.408202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.408627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.542224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:47.549957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8349aea4-c1b6-4c89-8d30-c4878821ae1f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.155559 Sep 09 06:34:47.550526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 361/715] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:47 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:47.725253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:47.725900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:47.732166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.732655 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.733091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.733781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.734242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.734671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.786456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:47.787062 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:47.793730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.794263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.794814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.796745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:47.797441 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:47.797943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:47.803917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:48.048983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:48.060779 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e9634557-bab8-4ee4-8ad2-8242e9097bce tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1266 microversion: 2.1 time: 0.340065 Sep 09 06:34:48.062012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 355/716] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:47 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:48.082573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:48.090516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3cbb43a3-f03e-46ce-a3a2-97d04acae0d9 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1690 microversion: 2.1 time: 0.308067 Sep 09 06:34:48.091100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 362/717] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:47 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:48.374794 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:48.376014 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:48.383528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:48.384149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:48.384583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:48.385271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:48.385728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:48.386143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:48.417546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:48.417743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:48.418005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:48.418435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lazy-loading 'fault' on Instance uuid ebebb1d1-2de0-4afb-b816-797f5a4ed1ff {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:48.486830 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:48.497071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9094a069-eedb-4a71-be03-b42247d5ae82 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 200 len: 1327 microversion: 2.1 time: 0.126451 Sep 09 06:34:48.497641 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 356/718] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:48 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:48.573611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:48.574427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:48.576811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:48.577469 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=6 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:48.583531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:48.584085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:48.584579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:48.585959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:48.586429 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:48.586852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:48.833882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:48.841542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cd830af5-d91c-4e62-a91f-cbbfbbf6acca tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.272840 Sep 09 06:34:48.842108 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 363/719] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:48 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:49.085933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.086574 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:49.089617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:49.094032 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.094500 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.094939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.095671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.096138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.096567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.114868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.115670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:49.123586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.124607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.125493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.126896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.127866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.129464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.339901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:49.348312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-577ef730-b546-47a7-b0cc-f767d9c0cc3e tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1453 microversion: 2.1 time: 0.266996 Sep 09 06:34:49.349124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 357/720] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:49 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1453 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:49.368318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:49.373291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.373896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:49.377025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6c098898-44e1-4594-a5f6-59d3e363172a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1690 microversion: 2.1 time: 0.266600 Sep 09 06:34:49.377924 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 364/721] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:49 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1690 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:49.381670 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.382165 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.382633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.383341 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.383824 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.384257 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.520610 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.521369 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:49.527510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.528059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.528495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.529194 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.529662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.530088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.544123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff HTTP/1.1 Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:34:49.545831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:34:49.547198 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'ebebb1d1-2de0-4afb-b816-797f5a4ed1ff'} Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:49.548127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:34:49.549571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:49.552192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:49.552192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a242d2fc-4b70-4bfa-ac5b-5087d83dd6b7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 404 len: 111 microversion: 2.1 time: 0.030655 Sep 09 06:34:49.552192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 365/722] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:49 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:49.557921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-36689cbf-711c-48e6-bdab-5f17711cbae2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '.version_select at 0x7f74acfdc430>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.573573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:49.581276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-36689cbf-711c-48e6-bdab-5f17711cbae2 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338580225" status: 202 len: 0 microversion: 2.1 time: 0.027900 Sep 09 06:34:49.585613 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 366/723] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 9 06:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338580225 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:34:49.606247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:49.615315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8e67f193-da6d-4065-9ba1-1d4177b031f3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1453 microversion: 2.1 time: 0.246092 Sep 09 06:34:49.616551 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 358/724] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:49 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1453 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:49.865876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:49.866491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:49.883806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.904040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.907476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:49.911534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:49.912140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:49.912583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:50.086836 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc563f30-0bc9-4f2d-a07f-5c18471ec9fd", "name": "network-vif-deleted", "tag": "a274b4a0-61a9-4a18-853c-5cf4edeb4692"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:50.104631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:50.106908 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:50.112832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:50.135931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] Creating event network-vif-deleted:a274b4a0-61a9-4a18-853c-5cf4edeb4692 for instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd on hv-cinder-85220 Sep 09 06:34:50.146391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-0117842b-b205-44cd-93df-824cf5b9e0ed req-36e17a33-260e-43a5-bf72-641c5fd49895 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318862 Sep 09 06:34:50.148876 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 367/725] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:50.226811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:50.234748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d5b60be8-36e6-461b-8812-d5d4c73dbf6d tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.373458 Sep 09 06:34:50.235942 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 359/726] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:49 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:50.402643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:50.403948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:50.413238 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:50.413720 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:50.414348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:50.415202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:50.415877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:50.416586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:50.465036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:50.465735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:50.466359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:50.466981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'fault' on Instance uuid fc563f30-0bc9-4f2d-a07f-5c18471ec9fd {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:50.485411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-95ac242d-6137-415f-a8dd-166e4fe4c67c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: .version_select at 0x7f74ad067f70>, body: {"keypair": {"name": "tempest-keypair-2043807172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9aUpjV33vRwEurEiRjOMzECyAT4tg2+lSQRLqMBntHLA9GmpD4JbFkoWCkVLQRSXSjY1r7AT1W+Ro6m+rtdf09bJ1o1esjl09DhT1VZRAb6PIm0WXvqaznRPpVU259+A=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:50.507056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-95ac242d-6137-415f-a8dd-166e4fe4c67c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for project 7a732015d4244c378e0204e1d216f57b. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:50.511077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-95ac242d-6137-415f-a8dd-166e4fe4c67c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for user 1c86ccfec70340c797ecba83163ff1a2 and project 7a732015d4244c378e0204e1d216f57b. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:50.522435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:50.532739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d849e6a8-e5ac-4350-a7dc-fd948e6e8e32 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 200 len: 1336 microversion: 2.1 time: 0.135283 Sep 09 06:34:50.539800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-95ac242d-6137-415f-a8dd-166e4fe4c67c tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058327 Sep 09 06:34:50.541020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 360/727] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:34:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:50.547262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 368/728] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:50 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 1336 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:51.259749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:51.260754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:51.267436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:51.268315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:51.269015 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:51.270840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:51.271611 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:51.272258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:51.493677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:51.502869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5eeb7f75-06b2-4afa-959e-ff489fa1ca2f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.246963 Sep 09 06:34:51.504641 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 361/729] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:51 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:51.563768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:51.574162 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: fc563f30-0bc9-4f2d-a07f-5c18471ec9fd] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:51.590182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:51.590677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:51.591107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:51.592121 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:51.592574 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:51.594557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:51.611783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] HTTP exception thrown: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Request method failure captured: Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd HTTP/1.1 Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1AGUILD7DmLsRt9aOu-ikMi1F0qGBHhXrTQ-5XEIwFapJRgo8vsHmPk_UHXcLVq0KtG6BGuztRCoJe4rfPIQIG3QNjuh6Yn3ENa8VU3hcBQ7GoOwtMQP0oWKFVFSy19m52T1JZd8PYkuYsKUYhlja-kZv6XszXUOaBOKyA5PZdxww Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:34:51.621487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 3e2bdc73390a43ff9eccc57948e2b4a6 Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. Sep 09 06:34:51.622954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'fc563f30-0bc9-4f2d-a07f-5c18471ec9fd'} Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:34:51.623790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. Sep 09 06:34:51.625059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:34:51.626173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Returning 404 to user: Instance fc563f30-0bc9-4f2d-a07f-5c18471ec9fd could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:34:51.626173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-faa9d6e8-a839-4062-8a07-9578b59ce3d0 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd" status: 404 len: 111 microversion: 2.1 time: 0.063640 Sep 09 06:34:51.626173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 369/730] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:51 2022] GET /compute/v2.1/servers/fc563f30-0bc9-4f2d-a07f-5c18471ec9fd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:34:51.632288 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0270d740-b15c-4993-b6f2-1f8517f4d5cc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '.version_select at 0x7f74ad076670>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:51.644160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:51.654999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0270d740-b15c-4993-b6f2-1f8517f4d5cc tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568418446" status: 202 len: 0 microversion: 2.1 time: 0.027090 Sep 09 06:34:51.655837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 362/731] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 9 06:34:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568418446 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:34:52.197362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-530935998", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50724a19-0cd0-47ed-ac64-73793b689a02"}], "security_groups": [{"name": "tempest-securitygroup--1714607401"}], "key_name": "tempest-keypair-2043807172", "user_data": "}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:52.421542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] validate_networks() for [('50724a19-0cd0-47ed-ac64-73793b689a02', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:34:52.441935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de17e99-45f8-4fdc-8e35-f0f38d6737f8", "tag": "3690fe7c-0bd9-4039-a5dd-e333a1aaefe2"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:52.455949 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:52.456447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:52.457434 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:52.469530 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] Creating event network-changed:3690fe7c-0bd9-4039-a5dd-e333a1aaefe2 for instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 on hv-cinder-85220 Sep 09 06:34:52.475471 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-0cb3f5cc-d37a-4e84-949c-f92879cff348 req-ad509ad2-77cf-4ed6-8df9-e10ae69d8287 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037669 Sep 09 06:34:52.476134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 363/732] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:34:52.529200 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:52.529781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:52.537465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:52.537968 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:52.538412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:52.539419 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:52.539946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:52.540551 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:52.933438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:52.942277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-12bb6ca3-d8e1-4a8e-81db-6e2a46a83370 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.419090 Sep 09 06:34:52.953050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 364/733] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:52 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:53.338315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:34:53.338827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:34:53.339432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:34:53.339961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:34:53.340500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:34:53.350871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:53.351485 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:53.352170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:53.353838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:53.354586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:53.355251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:53.372973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for project 7a732015d4244c378e0204e1d216f57b. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:34:53.377496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Getting quotas for user 1c86ccfec70340c797ecba83163ff1a2 and project 7a732015d4244c378e0204e1d216f57b. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:34:53.390959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:34:53.393824 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:34:53.447246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac10809e-5b35-4e35-8da6-6fcd1db62de3 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.254524 Sep 09 06:34:53.454609 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 370/734] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:34:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:34:53.461234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1789dfe0-4d0a-4a1a-b0f1-e9b5d69b0ff9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:53.461851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1789dfe0-4d0a-4a1a-b0f1-e9b5d69b0ff9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:53.551838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1789dfe0-4d0a-4a1a-b0f1-e9b5d69b0ff9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:53.560284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1789dfe0-4d0a-4a1a-b0f1-e9b5d69b0ff9 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1237 microversion: 2.1 time: 0.104355 Sep 09 06:34:53.561165 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 365/735] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:53 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:53.966873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:53.967390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:53.973909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:53.974391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:53.974818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:53.975519 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:53.975975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:53.976394 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:54.131228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:54.139597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a5b9d44f-331b-4f08-a9cc-7b9b09112aea tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.177099 Sep 09 06:34:54.140170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 371/736] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:53 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:54.229371 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12b4fc4-0305-4f63-94a7-5065cbcb0131", "name": "network-vif-plugged", "status": "completed", "tag": "5b26d108-0a54-4684-a651-7c4059439a0e"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:54.241489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:54.242085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:54.242616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:54.253719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] Creating event network-vif-plugged:5b26d108-0a54-4684-a651-7c4059439a0e for instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 on hv-cinder-85220 Sep 09 06:34:54.258693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-79be657e-92f3-4e48-a720-bd65cc412dda req-24fd2a13-de93-40c9-a0f3-2d827d3f7483 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033423 Sep 09 06:34:54.259369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 366/737] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:54.584692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:54.585450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:54.593078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:54.593542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:54.593976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:54.594678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:54.595170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:54.595611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:54.695883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:54.703993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac53a99e-8d5d-4841-86a3-4b02ce1e42db tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1289 microversion: 2.1 time: 0.123782 Sep 09 06:34:54.704572 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 372/738] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:54 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:55.164581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:55.165303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:55.171399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.171914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.172342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.173024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.173476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.173894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.489691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:55.490247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:55.497278 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.497769 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.498204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.498897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.499354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.499800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.526539 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:34:55.616821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-66219c6b-7cda-4188-98df-370bc51caf17 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 204 len: 0 microversion: 2.1 time: 0.130765 Sep 09 06:34:55.617439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 373/739] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:34:55 2022] DELETE /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 06:34:55.626909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:55.627631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:55.633831 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.634319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.634754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.635444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.635971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.636379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.647323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:55.655143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4ee3c56d-287f-4ccd-9032-e4ea712ef42e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.496127 Sep 09 06:34:55.656047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 367/740] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:55 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:55.726706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:55.727306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:55.733176 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.734068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.734507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.735203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:55.735690 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:55.736116 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:55.840268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:55.848281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0bfc38ed-2b59-4195-bd56-57d61275788b tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1295 microversion: 2.1 time: 0.125884 Sep 09 06:34:55.848856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 368/741] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:55 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:55.897966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:55.906262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-98e20d21-6c8d-416a-9656-b4151cf46e28 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1506 microversion: 2.1 time: 0.284134 Sep 09 06:34:55.906839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 374/742] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:55 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:56.101912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:56.102487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:56.108973 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.109467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.109966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.110732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.111283 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.112041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.141017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-442f8e54-54a7-43ee-8b51-de5c4e173555 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/ips" status: 200 len: 150 microversion: 2.20 time: 0.156943 Sep 09 06:34:56.141579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 369/743] 10.222.0.25 () {60 vars in 1289 bytes} [Fri Sep 9 06:34:55 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/ips => generated 150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:34:56.678993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:56.679515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:56.685892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.686376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.686810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.687499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.687983 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.688416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.820631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:56.828172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-448aa744-e637-4ab4-b2ec-1b3dbbc451e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1366 microversion: 2.1 time: 0.153162 Sep 09 06:34:56.828736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 375/744] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:56 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:56.871080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:56.871720 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:56.878108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.879179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.879637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.880331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.880791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.881215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.895884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:56.930182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:56.930702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:56.936587 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.937072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.937504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:56.938186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:56.938643 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:56.939066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:57.049191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:57.057771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1438317b-7a13-4cd7-8db5-bff31af09d7a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.190514 Sep 09 06:34:57.058343 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 370/745] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:56 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:57.098391 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:57.106091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1ba694de-abbf-4d08-8d88-f8af0fe15dd8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1506 microversion: 2.1 time: 0.180406 Sep 09 06:34:57.106664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 376/746] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:56 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:57.829240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2516d5f-2633-4271-b038-8992955bbae1", "tag": "8d536160-685a-4a21-ade7-c13d278af1b5"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:57.841468 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:57.842138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:57.843259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:57.852329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:57.855393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] Creating event network-changed:8d536160-685a-4a21-ade7-c13d278af1b5 for instance d2516d5f-2633-4271-b038-8992955bbae1 on hv-cinder-85220 Sep 09 06:34:57.861101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-5cacb0e6-6012-4172-aa5e-e543e2322e58 req-d20d2805-7df5-442d-a147-f487b77f4f4f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036211 Sep 09 06:34:57.862281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 371/747] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:57.862995 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:57.870295 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:57.871031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:57.878028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:57.878861 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:57.879334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:57.879793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.082798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:58.083491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:58.090167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.090655 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.091093 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.091820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.092275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.092693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.248307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:58.256845 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-996f4814-bf55-4e2c-bc7b-a071295d84a0 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1556 microversion: 2.1 time: 0.408278 Sep 09 06:34:58.257428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 377/748] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:57 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1556 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:58.276524 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:58.277135 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:58.287222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.287749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.288183 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.288897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.289351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.289767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.489118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:58.497689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8a848478-2010-4aba-a58d-79c3ac885723 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.420022 Sep 09 06:34:58.498360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 372/749] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:58 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:34:58.503006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:58.504109 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:58.510349 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.510901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.511421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.512197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.512722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.513224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.650141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:58.657906 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4043d762-5016-466e-93c3-484e69fac87d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1506 microversion: 2.1 time: 0.385192 Sep 09 06:34:58.658566 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 378/750] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:58 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:58.664433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:58.664991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:58.672300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.672787 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.673221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.673908 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:58.674411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:58.674775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:58.678363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2000bf2a-bbec-4088-99e1-353bf690d47b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178760 Sep 09 06:34:58.678964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 373/751] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:34:58 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:58.711049 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'flavor' on Instance uuid 6ddc6991-2ae2-4350-be11-5f9255eeeba7 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:34:58.747631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:34:58.994604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-208bb22f-04a3-4e8f-b0e9-daae88005769 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/action" status: 202 len: 0 microversion: 2.20 time: 0.334601 Sep 09 06:34:58.995521 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 379/752] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 9 06:34:58 2022] POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:34:59.003574 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:59.005182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:59.012859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.013405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.014231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.014940 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.015396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.015842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.151251 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:59.159689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:59.161795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:59.163044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-01f5c91c-ddb5-441f-9e2b-a9df21d5a0b9 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.163552 Sep 09 06:34:59.163722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 374/753] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:34:58 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:34:59.521811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:59.522433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:59.529025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.529549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.529982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.530704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.531157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.531604 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.672555 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:59.681128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e077dbd4-2e8e-4199-9c0d-f42c24eaaf61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.164219 Sep 09 06:34:59.682124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 380/754] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:59 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:59.697114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:34:59.697995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:34:59.704271 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.704865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.708985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.709916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.710540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.711124 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.787105 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:34:59.794765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b48cc3ca-5fac-4050-b535-d8c98948667a tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 200 len: 1464 microversion: 2.1 time: 0.102414 Sep 09 06:34:59.795397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 375/755] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:34:59 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 1464 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:34:59.803934 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12b4fc4-0305-4f63-94a7-5065cbcb0131", "tag": "5b26d108-0a54-4684-a651-7c4059439a0e"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:59.814318 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.814899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.815331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.827380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] Creating event network-changed:5b26d108-0a54-4684-a651-7c4059439a0e for instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 on hv-cinder-85220 Sep 09 06:34:59.832208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-a77cd049-499d-42ea-8ceb-42d797910cbc req-b44c19f3-385c-4920-b55c-14aeac0dced8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131523 Sep 09 06:34:59.832979 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 381/756] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:34:59.897715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad4096e8-5fde-463f-8cc2-82018a809fdb", "name": "network-vif-deleted", "tag": "b1e8da49-94b9-46a5-9a14-14e91012d315"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:34:59.908629 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:34:59.909391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:34:59.910252 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:34:59.924101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] Creating event network-vif-deleted:b1e8da49-94b9-46a5-9a14-14e91012d315 for instance ad4096e8-5fde-463f-8cc2-82018a809fdb on hv-cinder-85220 Sep 09 06:34:59.930737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-d36c98a9-85b2-47b8-a048-e245b3d543e7 req-9fd6a9ae-1d50-40ad-b4c0-e9dcef8f58e4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037007 Sep 09 06:34:59.931874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 376/757] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:00.189464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:00.190153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:00.196310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.196793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.197220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.197898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.198351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.198763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.338035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:00.346595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:00.348453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:00.349620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-be046d5b-a074-427c-a717-f8ed6ac9df29 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.164872 Sep 09 06:35:00.350182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 382/758] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:00 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:00.709340 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:00.710177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:00.717908 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.718555 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.719096 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.720075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.721240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.721240 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.818375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:00.818981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: ad4096e8-5fde-463f-8cc2-82018a809fdb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:00.825676 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.826176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.826599 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.827301 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.827972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.828403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.844070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] HTTP exception thrown: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Request method failure captured: Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb HTTP/1.1 Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1AGUILD7DmLsRt9aOu-ikMi1F0qGBHhXrTQ-5XEIwFapJRgo8vsHmPk_UHXcLVq0KtG6BGuztRCoJe4rfPIQIG3QNjuh6Yn3ENa8VU3hcBQ7GoOwtMQP0oWKFVFSy19m52T1JZd8PYkuYsKUYhlja-kZv6XszXUOaBOKyA5PZdxww Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:35:00.845985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 3e2bdc73390a43ff9eccc57948e2b4a6 Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. Sep 09 06:35:00.848738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'ad4096e8-5fde-463f-8cc2-82018a809fdb'} Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:35:00.849654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. Sep 09 06:35:00.851344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:35:00.852732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Returning 404 to user: Instance ad4096e8-5fde-463f-8cc2-82018a809fdb could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:35:00.852732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2fe4e830-ebc1-4a4e-9d9e-10737a4bb027 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb" status: 404 len: 111 microversion: 2.1 time: 0.033914 Sep 09 06:35:00.852732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 383/759] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:00 2022] GET /compute/v2.1/servers/ad4096e8-5fde-463f-8cc2-82018a809fdb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:35:00.856866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:00.857356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:00.863224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.863752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.864398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.865163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:00.865553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:00.866164 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:00.893624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:35:00.981682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-469007b8-5f5f-4876-91d0-6120ab99d879 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 204 len: 0 microversion: 2.1 time: 0.128180 Sep 09 06:35:00.986380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 384/760] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:35:00 2022] DELETE /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:35:00.993359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:00.994386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:01.002223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:01.003022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:01.004059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:01.004775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:01.005233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:01.005993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:01.057226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:01.070386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8ecd7108-2308-41e3-b4d5-881a2b003020 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.365819 Sep 09 06:35:01.071627 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 377/761] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:00 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:01.177021 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:01.184764 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9b072846-0b1e-49d3-9080-1774dc3f51e8 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.196588 Sep 09 06:35:01.185334 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 385/762] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:00 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:01.374689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:01.375210 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:01.384650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:01.385160 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:01.385596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:01.386299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:01.387072 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:01.387503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:01.528121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:01.537205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:01.538632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:01.539873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-06055125-4e71-45c0-aaa5-327b6ec2efaa tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.169147 Sep 09 06:35:01.540791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 378/763] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:01 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:02.097926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:02.098828 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:02.105384 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.105879 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.106319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.107023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.107491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.107940 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.208999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:02.209850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:02.216557 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.217063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.217504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.218317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.218959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.219403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.246866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:02.255196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4444a16e-0a6b-49d1-a8af-8a6e9b90e2ab tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.162093 Sep 09 06:35:02.255804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 386/764] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:02 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:02.367008 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:02.374805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-333d9533-4a0c-4039-af51-0bba185b9f5b tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.170180 Sep 09 06:35:02.375384 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 379/765] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:02 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:35:02.567263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:02.567893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:02.573930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.574413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.574844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.575531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:02.576011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:02.576436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:02.708458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:02.716540 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:02.718046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:02.719289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cd21ae47-005a-49fa-8f30-bd6e918b23ef tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.156583 Sep 09 06:35:02.719946 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 387/766] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:02 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:03.278913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:03.279690 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:03.287292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.287797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.288254 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.288936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.289393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.289811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.395346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:03.396235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=6 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:03.400490 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:03.401101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:03.408145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.408633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.409067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.410308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.410790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.411213 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.427792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:03.435878 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8f93d035-6f95-4bb0-9b88-a0595fe73e24 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.160779 Sep 09 06:35:03.436448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 380/767] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:03 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:35:03.551527 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:03.559172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d26314ab-29fa-4d04-bb0a-3bc1a71ee518 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1521 microversion: 2.1 time: 0.165284 Sep 09 06:35:03.559768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 388/768] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:03 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:35:03.744869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:03.745476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:03.747406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:03.752590 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.753075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.753513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.754202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:03.754655 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:03.755078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:03.978195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:03.986304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:03.987854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:03.989022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d9fdd23f-8479-432e-9a15-562464ad5195 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.248168 Sep 09 06:35:03.989604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 381/769] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:03 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:04.268849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2516d5f-2633-4271-b038-8992955bbae1", "name": "network-vif-plugged", "status": "completed", "tag": "8d536160-685a-4a21-ade7-c13d278af1b5"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:04.280393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.281132 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.281555 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.294242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] Creating event network-vif-plugged:8d536160-685a-4a21-ade7-c13d278af1b5 for instance d2516d5f-2633-4271-b038-8992955bbae1 on hv-cinder-85220 Sep 09 06:35:04.299270 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-a2e42b9d-2151-4b3b-a857-78daea7a05a1 req-606df5e9-8175-4833-8505-23a9d038e742 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Sep 09 06:35:04.300069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 389/770] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:04.458574 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:04.459195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:04.465640 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.466129 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.466575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.467269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.467771 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.468187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.583947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:04.584818 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:04.591342 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.591954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.592389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.593087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.593545 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.593967 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.704309 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:04.712159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b45a6b8b-2f9c-421a-9c02-4a6ce75cfddb tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1479 microversion: 2.1 time: 0.133473 Sep 09 06:35:04.712822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 390/771] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:04 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1479 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:04.742529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd598c3-8746-4655-aac0-948a7964ac0f", "name": "network-vif-deleted", "tag": "cf6ccb53-c867-41af-9f4e-1efcea671fd8"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:04.751299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:04.751791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:04.752271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:04.752717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:04.759256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8419e811-81f2-4883-857e-a8e81cd5f5ad tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.304589 Sep 09 06:35:04.760002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 382/772] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:04 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:35:04.763640 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] Creating event network-vif-deleted:cf6ccb53-c867-41af-9f4e-1efcea671fd8 for instance 1dd598c3-8746-4655-aac0-948a7964ac0f on hv-cinder-85220 Sep 09 06:35:04.773798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-b9cc338e-45bc-48ce-88d7-b3743d26ff2c req-039e1245-e878-4120-b0e8-c7618d7eefde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035700 Sep 09 06:35:04.774375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 391/773] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:35:05.015038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:05.015688 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:05.022841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.023435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.024005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.024753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.025227 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.025643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.166530 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:05.174591 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:05.176084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:05.177237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9237c8ef-7607-4178-ba99-46ba9bf23e91 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.166616 Sep 09 06:35:05.177805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 383/774] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:05 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:05.739681 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:05.740376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:05.746449 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.746928 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.747356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.748059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.748515 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.748933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.779736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.780225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.780653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.781092 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lazy-loading 'fault' on Instance uuid 1dd598c3-8746-4655-aac0-948a7964ac0f {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:35:05.782168 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:05.782971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:05.790401 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.790892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.791328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.792054 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:05.792515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:05.793084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:05.823051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e2bdc73390a43ff9eccc57948e2b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fae936c35c54adfaf8cb0df7f4ca9dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:05.830593 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5d7e2655-3b71-440b-b547-6c319bb9ca09 tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 200 len: 1312 microversion: 2.1 time: 0.098315 Sep 09 06:35:05.831163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 392/775] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:05 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:05.936270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:05.944212 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f851ecd7-06c4-4417-92c7-1819348a1444 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1363 microversion: 2.1 time: 0.165810 Sep 09 06:35:05.944785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 384/776] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:05 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:06.202392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:06.203006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:06.209670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.210157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.210594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:06.211292 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.211780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.212208 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:06.344084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:06.352724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:06.354165 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:06.355329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-037aba15-d05d-4c54-a1d3-2f87a8796751 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.156883 Sep 09 06:35:06.365589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 393/777] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:06 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:06.854266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:06.854865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] [instance: 1dd598c3-8746-4655-aac0-948a7964ac0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:06.861205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.861682 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.862112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:06.863334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.863812 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.864237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:06.877311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] HTTP exception thrown: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Request method failure captured: Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f HTTP/1.1 Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1AGUILD7DmLsRt9aOu-ikMi1F0qGBHhXrTQ-5XEIwFapJRgo8vsHmPk_UHXcLVq0KtG6BGuztRCoJe4rfPIQIG3QNjuh6Yn3ENa8VU3hcBQ7GoOwtMQP0oWKFVFSy19m52T1JZd8PYkuYsKUYhlja-kZv6XszXUOaBOKyA5PZdxww Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:35:06.879625 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9fae936c35c54adfaf8cb0df7f4ca9dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 9fae936c35c54adfaf8cb0df7f4ca9dd Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2133789592 Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 3e2bdc73390a43ff9eccc57948e2b4a6 Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2133789592-project Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. Sep 09 06:35:06.881223 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '1dd598c3-8746-4655-aac0-948a7964ac0f'} Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:35:06.882161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. Sep 09 06:35:06.883685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:06.885183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] Returning 404 to user: Instance 1dd598c3-8746-4655-aac0-948a7964ac0f could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:35:06.885183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-90180c28-b0b0-4f4b-b5bd-219689f4ab3d tempest-ServerRescueNegativeTestJSON-2133789592 tempest-ServerRescueNegativeTestJSON-2133789592-project] 10.222.0.25 "GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f" status: 404 len: 111 microversion: 2.1 time: 0.030645 Sep 09 06:35:06.885183 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 385/778] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:06 2022] GET /compute/v2.1/servers/1dd598c3-8746-4655-aac0-948a7964ac0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:35:06.966547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:06.967848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:06.976678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.977442 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.977830 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:06.978605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:06.979144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:06.979991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:07.111762 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:07.119773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e18187cc-d754-4f9c-b6fc-bde37b8020e5 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1550 microversion: 2.1 time: 0.157090 Sep 09 06:35:07.120431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 394/779] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:35:06 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:07.142204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:07.142688 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:07.149435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:07.149922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:07.150355 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:07.151041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:07.151498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:07.151938 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:07.231943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-71fd14ad-3f4d-4553-ace8-43e72e0c3137 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093486 Sep 09 06:35:07.232615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 386/780] 10.222.0.25 () {58 vars in 1275 bytes} [Fri Sep 9 06:35:07 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:07.381190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:07.382361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:07.388965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:07.389452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:07.389877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:07.390567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:07.391020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:07.391434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:07.653781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:07.656446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:07.664585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:07.666193 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:07.667477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1f0a22f5-9752-4340-8f03-736a0a9650c4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.290323 Sep 09 06:35:07.668168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 395/781] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:07 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:08.302036 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2516d5f-2633-4271-b038-8992955bbae1", "tag": "8d536160-685a-4a21-ade7-c13d278af1b5"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:08.314313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:08.314907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:08.315832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:08.328722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] Creating event network-changed:8d536160-685a-4a21-ade7-c13d278af1b5 for instance d2516d5f-2633-4271-b038-8992955bbae1 on hv-cinder-85220 Sep 09 06:35:08.335025 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-23664042-8546-4019-9d40-54e013b0c5e0 req-0ae698c3-51f1-4ebf-aab5-54d08682f2ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037202 Sep 09 06:35:08.340097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 387/782] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:08.700875 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:08.701835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:08.714944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:08.716089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:08.716710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:08.717598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:08.718361 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:08.718943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:09.061083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:09.080624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:09.082614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:09.086791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-00b871be-3b49-47f7-9b5c-21f859ab233d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.394656 Sep 09 06:35:09.087393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 396/783] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:08 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:10.116485 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:10.118266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:10.135016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:10.137864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:10.138734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:10.139737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:10.140543 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:10.140982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:10.363606 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:10.373853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:10.375317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:10.385835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e8291c5d-db1c-429d-91db-01680b4f3779 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.266757 Sep 09 06:35:10.388012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 388/784] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:10 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:11.417670 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:11.418286 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:11.424947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:11.425440 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:11.425870 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:11.426571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:11.427039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:11.427492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:11.569471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:11.578281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:11.580714 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:11.582548 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ea62e7b0-25da-4a9f-afb0-5aaa396cb37d tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.173565 Sep 09 06:35:11.595571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 397/785] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:11 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:11.657166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d34335ca-840a-4ef9-873f-efeff13a2843 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Action: 'create', calling method: .version_select at 0x7f74acf9c820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1541518004", "metadata": {"Type": "work"}}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:11.949184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d34335ca-840a-4ef9-873f-efeff13a2843 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.422518 Sep 09 06:35:11.949803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 389/786] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 9 06:35:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 424 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 09 06:35:11.963326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-991b6093-3d69-4c88-8979-336aafca47b2 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74acec9af0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:12.014389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-991b6093-3d69-4c88-8979-336aafca47b2 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 200 len: 353 microversion: 2.1 time: 0.054757 Sep 09 06:35:12.015138 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 398/787] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:11 2022] GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:12.610684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:12.611283 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:12.618807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:12.619289 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:12.619761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:12.620445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:12.620899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:12.621318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:12.748437 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:12.756911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:12.758351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:12.759508 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2b1b1125-07bf-4c18-9611-c22078a7ed9c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.153172 Sep 09 06:35:12.760085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 390/788] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:12 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:13.029708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d2c8349f-e629-4e01-9ecd-57e5c93a33f6 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74acf78940>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:13.076007 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d2c8349f-e629-4e01-9ecd-57e5c93a33f6 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 200 len: 354 microversion: 2.1 time: 0.050477 Sep 09 06:35:13.076569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 399/789] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:13 2022] GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:13.089609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-54ee8850-7062-4f99-8ba3-63949b62153a tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74ad011ee0>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:13.136933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-54ee8850-7062-4f99-8ba3-63949b62153a tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 200 len: 354 microversion: 2.1 time: 0.051008 Sep 09 06:35:13.137504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 391/790] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:13 2022] GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:13.150656 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d941a0b2-a52b-4cd1-8a24-517810ca3a06 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74acf1dca0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:13.211863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d941a0b2-a52b-4cd1-8a24-517810ca3a06 tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 202 len: 0 microversion: 2.1 time: 0.064809 Sep 09 06:35:13.212423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 400/791] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:35:13 2022] DELETE /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:35:13.220375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1dce8ebd-d62f-44d6-ae9c-38c37e97165f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74acfb7e50>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:13.267445 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1dce8ebd-d62f-44d6-ae9c-38c37e97165f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 200 len: 353 microversion: 2.1 time: 0.050895 Sep 09 06:35:13.268086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 392/792] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:13 2022] GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:13.784939 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:13.785479 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:13.791508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:13.792020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:13.792457 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:13.793137 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:13.793592 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:13.794011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:13.924600 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:13.932820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:13.934245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:13.935451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2f4900f6-0d65-4f1c-ae5e-8a3c039f080c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.154784 Sep 09 06:35:13.936024 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 401/793] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:13 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:14.283691 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-372c607e-b957-4db9-bb32-21baff7a219f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Calling method '.version_select at 0x7f74acfa9b80>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:14.311882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-372c607e-b957-4db9-bb32-21baff7a219f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] HTTP exception thrown: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-372c607e-b957-4db9-bb32-21baff7a219f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Request method failure captured: Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 HTTP/1.1 Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt6f6iCYh7jCoqKutTCWB0X6g-uwjkZuTo5OSBwH84-4dFUloNkizPuZ0C_SddizXGmeM1CjRfRVy-72KzHDm5AyA9cu8kg-Ts_22tQJ8jYq4fRGp0gdludurLNYLVdxRBmHu4IGw33c1d1cjKKVG1q5CTiFHYTJjThVsv4gsM_HE0k Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 2f1a472904b84adf8b0d2f4534da907b Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-VolumesGetTestJSON-1027589074 Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:35:14.315204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f1a472904b84adf8b0d2f4534da907b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2f1a472904b84adf8b0d2f4534da907b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2f1a472904b84adf8b0d2f4534da907b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2f1a472904b84adf8b0d2f4534da907b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-VolumesGetTestJSON-1027589074 Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 2f1a472904b84adf8b0d2f4534da907b Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-VolumesGetTestJSON-1027589074 Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-VolumesGetTestJSON-1027589074-project Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: a5dff88c013349bcabc48914c0be6d16 Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-VolumesGetTestJSON-1027589074-project Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'b4cca89c-aede-4724-9871-550929ee3ff6'} Sep 09 06:35:14.317573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. (HTTP 404) (Request-ID: req-e1668c75-ba62-4a86-bd10-714f5b59358e) Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:14.318546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:35:14.320110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 06:35:14.321488 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-372c607e-b957-4db9-bb32-21baff7a219f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] Returning 404 to user: Volume b4cca89c-aede-4724-9871-550929ee3ff6 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-372c607e-b957-4db9-bb32-21baff7a219f tempest-VolumesGetTestJSON-1027589074 tempest-VolumesGetTestJSON-1027589074-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6" status: 404 len: 109 microversion: 2.1 time: 0.037914 Sep 09 06:35:14.323012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 393/794] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:14 2022] GET /compute/v2.1/os-volumes/b4cca89c-aede-4724-9871-550929ee3ff6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:35:14.961012 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:14.961624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:14.967614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:14.968308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:14.968740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:14.969419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:14.969873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:14.970288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:15.103735 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:15.111957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:15.113608 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:15.114794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d33dbf43-bbef-4d61-b35f-61ee2207cf5a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.158471 Sep 09 06:35:15.115360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 402/795] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:14 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:16.141395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:16.142003 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:16.148628 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:16.149115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:16.149546 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:16.150230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:16.150691 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:16.151115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:16.167264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=100 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:16.287967 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:16.296149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:16.297592 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:16.298749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-db7063cb-fa9b-4c94-956a-daa3e3a01ca8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.161922 Sep 09 06:35:16.299303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 394/796] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:16 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:17.027484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bb99ff55-abc2-4f24-882f-9c46c36a0344 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acef03a0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:17.074672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bb99ff55-abc2-4f24-882f-9c46c36a0344 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/cba7fa42-9210-4e21-b05d-76d07f7303a5" status: 200 len: 350 microversion: 2.1 time: 0.050892 Sep 09 06:35:17.075327 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 403/797] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:17 2022] GET /compute/v2.1/os-volumes/cba7fa42-9210-4e21-b05d-76d07f7303a5 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:17.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:17.327030 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:17.334699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:17.335577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:17.349706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:17.349706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:17.349706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:17.349706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:17.471396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:17.479705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:17.481145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:17.482313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9cf7fc8b-d424-4dcd-abde-c623b488417e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.161588 Sep 09 06:35:17.482876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 395/798] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:17 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:18.413287 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5e8ebfbc-3c4d-4f1a-9d50-a24f6b5f7d9a tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acebe040>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:18.459462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5e8ebfbc-3c4d-4f1a-9d50-a24f6b5f7d9a tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2ec1d30f-fe85-4a06-91b9-71b43d89e6b2" status: 200 len: 350 microversion: 2.1 time: 0.051180 Sep 09 06:35:18.460112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 404/799] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:18 2022] GET /compute/v2.1/os-volumes/2ec1d30f-fe85-4a06-91b9-71b43d89e6b2 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:18.508144 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:18.509038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:18.517332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:18.518057 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:18.519070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:18.519976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:18.520663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:18.521090 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:18.682422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:18.691710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:18.693417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:18.707346 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a4c3c86c-2a98-4fda-a90c-e464d8f420f3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.203557 Sep 09 06:35:18.708048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 396/800] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:18 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:19.733719 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:19.734324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:19.736986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:19.743642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:19.744127 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:19.744558 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:19.745241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:19.745696 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:19.746114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:19.831833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cdae4d98-7295-41ee-84fa-258c69fc051f tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acfb7430>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:19.881768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:19.885177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cdae4d98-7295-41ee-84fa-258c69fc051f tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b396c429-76db-43a3-8945-8ca6858869a6" status: 200 len: 351 microversion: 2.1 time: 0.057754 Sep 09 06:35:19.885829 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 397/801] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:35:19 2022] GET /compute/v2.1/os-volumes/b396c429-76db-43a3-8945-8ca6858869a6 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:35:19.889953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:19.891392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:19.892576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-68940502-f053-4c4c-853c-9f280b319c42 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.163245 Sep 09 06:35:19.893114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 405/802] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:19 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:19.899228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-25401624-94f6-42dc-903a-40651c183a12 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74ad030160>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:19.981235 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-25401624-94f6-42dc-903a-40651c183a12 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085559 Sep 09 06:35:19.981800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 398/803] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 9 06:35:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:35:19.996313 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0daa6b2a-eb08-4eee-b51a-c9c5099c8e70 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acf8f670>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.079839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0daa6b2a-eb08-4eee-b51a-c9c5099c8e70 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087107 Sep 09 06:35:20.080414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 406/804] 10.222.0.25 () {58 vars in 1149 bytes} [Fri Sep 9 06:35:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:20.094037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-37458b9d-311e-4256-89e2-7ab8a0d88722 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acfdce50>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.180534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-37458b9d-311e-4256-89e2-7ab8a0d88722 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090130 Sep 09 06:35:20.181106 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 399/805] 10.222.0.25 () {58 vars in 1134 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:20.195107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-dc0cba4e-e78a-456b-a83a-4459773f9d6d tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74ace59ca0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.280778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-dc0cba4e-e78a-456b-a83a-4459773f9d6d tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090212 Sep 09 06:35:20.281364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 407/806] 10.222.0.25 () {58 vars in 1167 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:20.295066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-71032288-a839-4a6b-bdea-758ee7a4ac2d tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acf9a700>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.378560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-71032288-a839-4a6b-bdea-758ee7a4ac2d tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086417 Sep 09 06:35:20.379128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 400/807] 10.222.0.25 () {58 vars in 1170 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:20.392772 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cd098ed8-d34d-4496-9cf1-77ecac42acfa tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acec9c10>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.474358 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cd098ed8-d34d-4496-9cf1-77ecac42acfa tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085214 Sep 09 06:35:20.474935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 408/808] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:20.488822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-844281be-5399-4461-9585-ae8a2ffa3a52 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74acf9cee0>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.570692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-844281be-5399-4461-9585-ae8a2ffa3a52 tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086017 Sep 09 06:35:20.571267 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 401/809] 10.222.0.25 () {58 vars in 1188 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:20.584753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c3e8af8e-5161-496b-b51b-89426497fe1b tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] Calling method '.version_select at 0x7f74ace59670>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.668608 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c3e8af8e-5161-496b-b51b-89426497fe1b tempest-VolumesTestJSON-1778363000 tempest-VolumesTestJSON-1778363000-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087627 Sep 09 06:35:20.669187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 409/810] 10.222.0.25 () {58 vars in 1155 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:35:20.919115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:20.919717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:20.926479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:20.926964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:20.927395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:20.928131 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:20.928583 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:20.929078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:21.061977 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:21.070774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:21.072342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:21.073497 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-742c114c-4cec-4b46-8ffe-15ac358718c1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1743 microversion: 2.20 time: 0.159050 Sep 09 06:35:21.074059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 402/811] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:20 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:22.101018 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:22.101607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:22.108451 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:22.108953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:22.109413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:22.110160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:22.110619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:22.111041 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:22.243737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:22.251820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:22.253801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:22.254998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d2f259c8-97ca-4f62-90d0-867d5706c1d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1743 microversion: 2.20 time: 0.159047 Sep 09 06:35:22.255563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 410/812] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:22 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:23.280867 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:23.281598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:23.284698 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=65 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:23.290262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:23.290821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:23.291259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:23.291979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:23.292440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:23.292849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:23.432532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:23.441224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:23.442879 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:23.444056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6a0e1592-b20f-42ad-b367-648ed1acadda tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.167117 Sep 09 06:35:23.444792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 403/813] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:23 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:24.472590 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:24.473912 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:24.488788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:24.489604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:24.490526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:24.493798 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:24.494461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:24.495043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:24.672052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "name": "network-vif-plugged", "status": "completed", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:24.693503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:24.694252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:24.694842 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:24.711647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] Creating event network-vif-plugged:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:35:24.717696 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-ed989ee5-906b-4abd-9b9e-e8bbf0074796 req-948854cc-b4a2-4f76-b921-1e07af48b725 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268324 Sep 09 06:35:24.718815 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 411/814] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:24.739082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:24.749285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:24.751313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:24.753528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bc33ec6f-77cb-47ec-a6b4-380e655a95b8 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.286148 Sep 09 06:35:24.768988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 404/815] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:24 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:35:25.784079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:25.785521 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:25.792598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:25.793400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:25.794246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:25.797986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:25.800648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:25.801453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:25.976192 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:25.985790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:25.988407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:25.990363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e486ae14-eda1-4e0f-8156-77fa8fcbb20e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.210027 Sep 09 06:35:25.991379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 412/816] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:25 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:27.018842 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:27.020883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:27.033790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:27.034533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:27.035206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:27.036623 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:27.037658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:27.038585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:27.264504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:27.280781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:27.282398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:27.286268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9a03dfc8-2052-486f-a9fc-9c85f129c9bd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.273052 Sep 09 06:35:27.287091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 405/817] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:27 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:28.312741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:28.313353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:28.323508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:28.324254 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:28.324873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:28.325781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:28.326443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:28.327049 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:28.508142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:28.521742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:28.523578 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:28.524948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-295753a6-8ea7-491b-9081-9293c1dbda79 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.215940 Sep 09 06:35:28.526322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 413/818] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:28 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:29.555935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:29.557178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:29.569544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:29.570709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:29.571587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:29.573004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:29.573648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:29.574388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:29.736167 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:29.746531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:29.748509 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:29.750058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c0f2e17e-f84b-408b-a6da-44d26e287ce1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.201673 Sep 09 06:35:29.750861 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 406/819] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:29 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:35:30.777590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:30.778219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:30.789431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:30.790085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:30.790531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:30.791242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:30.791914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:30.792526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:30.954774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:30.966726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:30.968914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:30.989355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-36711116-bed2-4e85-aec1-b17607a06ffd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.213753 Sep 09 06:35:30.990430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 414/820] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:30 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:32.017518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:32.019957 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:32.027762 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:32.028308 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:32.028677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:32.029533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:32.029987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:32.030413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:32.214845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:32.224337 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:32.225992 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:32.227626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5e47da0f-1f45-4229-a160-05244076302a tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.214143 Sep 09 06:35:32.228600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 407/821] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:32 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:33.255294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:33.255961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:33.262863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:33.263484 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:33.264232 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:33.264890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:33.265614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:33.266105 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:33.403341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:33.413146 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:33.414601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:33.415808 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-90051769-75de-4608-8d5a-2f44d6d99664 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1738 microversion: 2.20 time: 0.165348 Sep 09 06:35:33.416381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 415/822] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:33 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:34.442353 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:34.442980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:34.450552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:34.451002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:34.451435 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:34.452231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:34.452630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:34.453021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:34.593138 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:34.601704 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:34.603136 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:34.604330 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-296f95de-d6a0-41fb-9022-f006037df33b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1720 microversion: 2.20 time: 0.166477 Sep 09 06:35:34.604889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 408/823] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:34 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:35.630926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:35.631530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:35.638305 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:35.638791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:35.639218 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:35.639929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:35.640381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:35.640795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:35.767838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:35.776508 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:35.777948 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:35.779101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-05603f20-16ec-46b1-bdbc-0cc3051268d1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1720 microversion: 2.20 time: 0.152817 Sep 09 06:35:35.779690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 416/824] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:35 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:36.805746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:36.806379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:36.812318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:36.813031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:36.813462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:36.814347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:36.815708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:36.816143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:36.952140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:36.961033 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:36.962556 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:36.963869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a1545819-8f18-4526-b677-945a5c23583e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1663 microversion: 2.20 time: 0.162758 Sep 09 06:35:36.964539 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 409/825] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:36 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:36.990385 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6a321f0-50a4-4a73-b743-af7131cf022b"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:36.992898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:36.999258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:36.999778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.000211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.000900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.001354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.001826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.297329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-31dafbb9-1267-4c75-bca1-2a5af8fb87ec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311749 Sep 09 06:35:37.298019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 417/826] 10.222.0.25 () {62 vars in 1364 bytes} [Fri Sep 9 06:35:36 2022] POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 06:35:37.432767 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:37.433257 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:37.439005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.439482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.440806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.441615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.442079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.442503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.691243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d6829e90-18e8-4113-84fa-ecacbb8665c6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments/e6a321f0-50a4-4a73-b743-af7131cf022b" status: 202 len: 0 microversion: 2.20 time: 0.262157 Sep 09 06:35:37.692016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 410/827] 10.222.0.25 () {60 vars in 1457 bytes} [Fri Sep 9 06:35:37 2022] DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments/e6a321f0-50a4-4a73-b743-af7131cf022b => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:35:37.754252 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:37.754850 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:37.760958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.761381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.761826 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.762502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.762957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.763382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.809354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120795) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 06:35:37.854098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:37.883085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-692dbb22-f363-404e-9458-ed9693e670cd tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/action" status: 202 len: 0 microversion: 2.20 time: 0.133446 Sep 09 06:35:37.884048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 418/828] 10.222.0.25 () {62 vars in 1319 bytes} [Fri Sep 9 06:35:37 2022] POST /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:35:37.892573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:37.893442 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:37.901952 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.902453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.903035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:37.903781 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:37.904450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:37.904982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:38.067580 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:38.076823 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:38.078549 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:38.080651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-87aa5345-fc1c-48c5-b113-ed60779ae2de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1671 microversion: 2.20 time: 0.192008 Sep 09 06:35:38.082216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 411/829] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:37 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:38.514459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:38.538819 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:38.539912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:38.540936 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:38.558981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.compute.server_external_events [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] Unable to find a host for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7. Dropping event network-vif-unplugged {{(pid=120795) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 06:35:38.560258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-029dcda8-8052-45eb-be55-26669d278c36 req-7e0642fd-ae2b-47aa-a722-0cc8ea4241c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052937 Sep 09 06:35:38.563163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 419/830] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 06:35:39.108729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:39.109552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:39.117006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:39.117840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:39.118412 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:39.119276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:39.119857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:39.120495 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:39.296994 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:39.305930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:39.307373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:39.308586 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2c4918c9-6cf9-46ea-b98c-d23a308d621b tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1671 microversion: 2.20 time: 0.203871 Sep 09 06:35:39.309157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 412/831] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:39 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:40.333862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:40.334615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:40.341731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:40.342293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:40.342804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:40.343598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:40.344124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:40.344808 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:40.494368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:40.502700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:40.504180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:40.505340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c9bd4610-fc9c-4e2d-8d25-13b7f23fd8bb tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.175638 Sep 09 06:35:40.505901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 420/832] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:40 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:41.532211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:41.532953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:41.540463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:41.540962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:41.541395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:41.542100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:41.542561 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:41.543177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:41.564636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:41.713424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:41.724436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:41.726297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:41.727482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9e757b21-4136-4b3a-be06-e68167693fa2 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.199206 Sep 09 06:35:41.728389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 413/833] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:41 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:35:42.752751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:42.753357 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:42.760011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:42.760496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:42.760926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:42.761626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:42.762086 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:42.762507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:42.905466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:42.915117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:42.916689 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:42.918034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f0d9396e-86ad-4d20-8199-36109b8e4192 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.169155 Sep 09 06:35:42.918664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 421/834] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:42 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:43.315626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:43.316734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:43.324199 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:43.324985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:43.325615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:43.326523 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:43.327176 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:43.328029 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:43.354269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4cd5fe16-f6c2-4275-886c-d6e41f64d500 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/ips" status: 200 len: 150 microversion: 2.1 time: 0.042890 Sep 09 06:35:43.354768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 414/835] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:35:43 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:43.948011 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:43.948641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:43.958151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:43.961288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:43.961816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:43.962615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:43.963908 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:43.964442 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:44.155452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:44.164230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:44.165682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:44.166857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8b7bcaa5-642a-46f5-8153-692809dce5e5 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.223905 Sep 09 06:35:44.178981 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 422/836] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:43 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:44.843501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26dd6a38-efcc-4eb0-b428-eff166c58006"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:44.848876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:44.855336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:44.855884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:44.856313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:44.857420 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:44.858045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:44.858636 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:45.194378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:45.195244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:45.203364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:45.204676 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:45.205773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:45.206589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:45.207148 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:45.207703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:45.385509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:45.396713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:45.401920 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:45.403386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-701ec5ba-fd54-44d3-924e-280cd53efcec tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.213105 Sep 09 06:35:45.404770 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 423/837] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:45 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:46.176262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:46.176749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:46.182665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:46.183157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:46.183605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:46.184492 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:46.184951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:46.185562 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:46.217464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-28799872-703a-4ab7-99e5-c423bfc6bd88 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/ips" status: 200 len: 147 microversion: 2.1 time: 0.045466 Sep 09 06:35:46.219692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 424/838] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:35:46 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:46.432897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:46.433816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:46.441927 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:46.442890 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:46.443516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:46.444414 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:46.445046 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:46.446118 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:46.720713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:46.731387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:46.733973 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:46.735740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d18fee44-4e51-41b5-9957-fbb12bea1496 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.309036 Sep 09 06:35:46.747674 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 425/839] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:46 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:47.716788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe6999cd-dae4-4a02-a3ba-7000d4882b7c"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:47.720186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:47.733091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:47.733755 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:47.734427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:47.736084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:47.736837 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:47.737462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:54.173822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-777c1f22-5e24-48c8-83de-05f03f8ffc61 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.461453 Sep 09 06:35:54.174799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 426/840] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:35:47 2022] POST /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 194 bytes in 6464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:35:54.180251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:54.183378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c432ad46-9be3-4c06-a515-096072bad6b2 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "POST /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.348324 Sep 09 06:35:54.190243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:54.197430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 415/841] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:35:44 2022] POST /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 194 bytes in 9363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:35:54.198375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:54.200621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:54.201141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:54.201534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:54.202236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:54.202692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:54.203150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:54.360446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:54.368898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:54.370329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:54.371495 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f8bc7c45-2877-45ba-8427-6729b7e52f30 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.195560 Sep 09 06:35:54.372083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 427/842] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:54 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:55.396015 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=25 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:35:55.400425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:55.401143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:55.407666 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:55.408378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:55.408811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:55.409567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:55.410052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:55.410477 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:55.541322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:55.550193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:55.551654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:55.552811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-89d8428e-435b-4e92-9c3a-42e462cc53b6 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.158386 Sep 09 06:35:55.553366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 416/843] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:55 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:56.578570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:56.579116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:56.585737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:56.586226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:56.586659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:56.587362 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:56.587863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:56.588290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:56.719863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:56.728999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:56.730433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:56.731637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f12bdd5b-7dd1-4f6d-a2da-df6cc81e49de tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.157100 Sep 09 06:35:56.732215 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 428/844] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:56 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:57.758250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:57.758858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:57.765373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:57.765872 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:57.766304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:57.767067 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:57.767599 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:57.768114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:57.902132 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:57.910563 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:57.912027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:57.913187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-aebab94b-f76a-4f13-8ca0-c5bf27d09dc4 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.158953 Sep 09 06:35:57.913785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 417/845] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:57 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:58.940431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:35:58.941047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:35:58.947892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:58.948374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:58.948803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:58.949498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:58.949944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:58.950695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:59.089878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:59.098482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:59.100139 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:35:59.101402 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-fb076cd3-ac33-4599-97d0-9ac8102bf7a1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.166084 Sep 09 06:35:59.101960 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 429/846] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:35:58 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:35:59.714276 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "name": "network-vif-plugged", "status": "completed", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:35:59.725364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:35:59.725844 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:35:59.726270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:35:59.738426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] Creating event network-vif-plugged:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:35:59.743809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-a1403f77-39e2-4f89-9a6e-e572b125b657 req-1be3afc2-1374-4044-8808-a999bb45d652 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Sep 09 06:35:59.744147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 418/847] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:00.136193 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:00.136832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:00.143613 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:00.144110 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:00.144547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:00.145244 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:00.145878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:00.146306 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:00.282131 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:00.290768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:00.292240 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:00.293395 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2acea682-b5ec-4271-9d06-9af5358f2ad1 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.161303 Sep 09 06:36:00.293959 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 430/848] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:00 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:01.323067 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:01.323801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:01.348578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:01.348578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:01.348578 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:01.349999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:01.349999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:01.349999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:01.523021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:01.533613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:01.535431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:01.536653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-46ebcf3a-1028-4549-b879-26c0c6b8a393 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.219545 Sep 09 06:36:01.537319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 419/849] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:01 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:02.570221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:02.570828 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:02.577261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:02.577752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:02.578188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:02.578888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:02.579977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:02.580408 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:02.711068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:02.719145 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:02.720616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:02.722191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9202be9b-7464-4ac6-b7da-c6b388dead5c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.155659 Sep 09 06:36:02.723058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 431/850] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:02 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:36:03.748027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:03.748544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:03.755849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:03.756342 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:03.756778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:03.757482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:03.757944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:03.758368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:03.898020 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:03.906018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:03.908187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:03.909606 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-c32cab1d-f2b5-4d72-b158-95cc85bcaf94 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1729 microversion: 2.20 time: 0.165594 Sep 09 06:36:03.910164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 420/851] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:03 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:04.935977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:04.936589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:04.943470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:04.943993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:04.944427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:04.945113 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:04.945580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:04.946001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:05.088788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:05.098058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:05.099425 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:05.100947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-df97ad6f-5d05-4dab-b506-67933ba6bf2e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1716 microversion: 2.20 time: 0.168893 Sep 09 06:36:05.101851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 432/852] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:04 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:06.015462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:06.018330 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:06.024978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:06.025380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:06.025813 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:06.026653 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:06.027114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:06.027746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:06.061095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2e61073c-485b-4042-aaa5-1971bebe59d7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049358 Sep 09 06:36:06.061579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 421/853] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:06 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:06.072612 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:06.073134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:06.080436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:06.080871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:06.081303 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:06.081987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:06.082437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:06.082854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:06.113284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2730d899-cb7c-47e4-b598-7d16e905c5f7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c" status: 200 len: 194 microversion: 2.1 time: 0.044714 Sep 09 06:36:06.113852 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 433/854] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 9 06:36:06 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:07.460786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ecd7411-984d-4d4c-b1f8-5c575211619d"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:07.463219 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:07.471856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:07.472439 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:07.472930 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:07.473705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:07.474329 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:07.474719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:07.714687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-39d731eb-83ee-406e-9d91-dbdaeffec7c6 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "POST /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257985 Sep 09 06:36:07.715316 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 422/855] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:36:07 2022] POST /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:12.506654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:12.507165 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:12.514076 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:12.514558 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:12.514994 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:12.515707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:12.516805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:12.517320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:12.519841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:12.599707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'services' on Instance uuid c12b4fc4-0305-4f63-94a7-5065cbcb0131 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:36:12.668167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-839a562a-21dc-4378-bb24-b0ed0057dd3e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments/26dd6a38-efcc-4eb0-b428-eff166c58006" status: 202 len: 0 microversion: 2.1 time: 0.165191 Sep 09 06:36:12.668758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 434/856] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:36:12 2022] DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments/26dd6a38-efcc-4eb0-b428-eff166c58006 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:12.679037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:12.681463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:12.688656 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:12.689159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:12.689610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:12.690320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:12.690803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:12.691234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:12.693783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:12.725047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4e8b28ec-8d0e-4a37-a747-ebb830da8416 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 Sep 09 06:36:12.725603 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 423/857] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:12 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:13.739616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:13.741952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:13.748256 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:13.748745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:13.749183 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:13.749871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:13.750329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:13.750886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:13.780176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-61cddc53-a950-4002-bc3e-499694fbbd14 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Sep 09 06:36:13.780721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 435/858] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:13 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:14.793498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:14.795619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:14.802068 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:14.802553 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:14.803019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:14.803734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:14.804195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:14.804616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:14.833156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a6ded44c-5f59-4de8-b870-7f0770382a52 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Sep 09 06:36:14.833701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 424/859] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:14 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:15.846274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:15.848662 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:15.855142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:15.855659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:15.856093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:15.856776 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:15.857236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:15.857655 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:15.886020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-add57f10-e547-45a4-bb65-a99f1ce57af5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Sep 09 06:36:15.886575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 436/860] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:15 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:16.897530 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:16.899696 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:16.906206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:16.907191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:16.907641 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:16.908328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:16.908785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:16.909205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:16.940035 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-bd525f8b-a9cb-4568-834c-9de3daccb6a6 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Sep 09 06:36:16.940585 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 425/861] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:16 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:17.952324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:17.954668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:17.961032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:17.961518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:17.961953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:17.962637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:17.963091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:17.963512 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:17.993195 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-587aeb29-8d82-47af-b43c-4d9fb8afd3c5 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Sep 09 06:36:17.993749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 437/862] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:17 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:19.006453 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:19.008606 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:19.014961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:19.015451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:19.016865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:19.017364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:19.017874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:19.018464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:19.050180 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a1e00660-e290-40d3-8817-dfd8f71884e3 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047834 Sep 09 06:36:19.050679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 426/863] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:19 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:20.063810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:20.066009 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:20.072407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:20.072892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:20.073324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:20.074006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:20.074458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:20.074878 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:20.103792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-18f105fa-3e1b-4b9d-b3cd-60885ea1b025 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 09 06:36:20.104343 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 438/864] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:20 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:21.116614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:21.118751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:21.125211 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:21.126499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:21.127110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:21.127854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:21.128312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:21.128735 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:21.160392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-00046017-d8c7-4521-b42c-7ce6ee579b22 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Sep 09 06:36:21.161274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 427/865] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:21 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:22.173448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:22.175730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:22.182346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.182885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.183380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:22.184143 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.184603 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.185072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:22.217925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5859807b-08c6-41bd-a610-562b7a660002 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048969 Sep 09 06:36:22.218535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 439/866] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:22 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:22.667256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:22.670150 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:22.677010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.677510 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.677949 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:22.678857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.679333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.679791 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:22.713047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5408668b-4967-4f40-8a2d-4abeaf59ad78 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049670 Sep 09 06:36:22.713621 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 428/867] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:22 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:22.822946 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:22.823322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:22.830407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.830896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.831447 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:22.832268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:22.832721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:22.833153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.016521 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-916f2f8c-7bf9-4b5b-b681-e2c965705e8a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c" status: 200 len: 194 microversion: 2.1 time: 0.196900 Sep 09 06:36:23.017209 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 440/868] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 9 06:36:22 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c => generated 194 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:23.027465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:23.028005 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:23.033870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.034357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.034790 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.035479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.035980 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.036405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.116736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lazy-loading 'services' on Instance uuid d2516d5f-2633-4271-b038-8992955bbae1 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:36:23.188768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-50cfb7a5-e503-4930-92ca-359c742d28cf tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c" status: 202 len: 0 microversion: 2.1 time: 0.164759 Sep 09 06:36:23.189402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 429/869] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:36:23 2022] DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/fe6999cd-dae4-4a02-a3ba-7000d4882b7c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 06:36:23.230701 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:23.232986 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:23.239526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.240250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.241004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.242087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.242552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.242977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.273424 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac530105-727e-4b3e-a161-34a0b167228f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046758 Sep 09 06:36:23.273977 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 441/870] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:23 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:36:23.338438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:23.338989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:23.345658 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.346146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.346849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.347562 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.348018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.348440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.373282 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:36:23.446295 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d6e5a524-a5f3-46d8-87ca-a49d7bf19b0e tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 204 len: 0 microversion: 2.1 time: 0.111822 Sep 09 06:36:23.446886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 430/871] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:23 2022] DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:36:23.455932 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:23.456546 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:23.462474 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.462965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.463401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.464123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:23.464583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:23.465008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:23.597722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:23.605399 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4e8aed73-3db4-498c-9553-6f1a52dd9269 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1681 microversion: 2.1 time: 0.154305 Sep 09 06:36:23.605956 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 442/872] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:23 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:24.630335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:24.631041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:24.637410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:24.637928 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:24.638358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:24.639042 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:24.639499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:24.640014 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:24.772071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:24.782467 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7d782e05-f5bd-4543-9f6f-76bad7105828 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1681 microversion: 2.1 time: 0.156814 Sep 09 06:36:24.783044 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 431/873] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:24 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:25.806438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:25.807053 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:25.809571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=32 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:25.815642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:25.816141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:25.816580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:25.817303 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:25.817734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:25.818159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.314792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:26.324528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-357d21fe-d466-4826-a02c-d1e82c1b1bed tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1681 microversion: 2.1 time: 0.521812 Sep 09 06:36:26.325496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 443/874] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:25 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1681 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:26.437373 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:26.438672 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:26.441357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:26.447328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:26.447748 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:26.448382 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.449148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:26.449610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:26.450040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.484822 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ca7b90e7-5d18-4712-861e-eba0173a5d8d tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/0ecd7411-984d-4d4c-b1f8-5c575211619d" status: 200 len: 194 microversion: 2.1 time: 0.051316 Sep 09 06:36:26.485864 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 432/875] 10.222.0.25 () {58 vars in 1413 bytes} [Fri Sep 9 06:36:26 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/0ecd7411-984d-4d4c-b1f8-5c575211619d => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:26.497780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:26.498489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:26.506638 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:26.507598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:26.508441 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.509372 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:26.510063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:26.511433 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.615445 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lazy-loading 'services' on Instance uuid d2516d5f-2633-4271-b038-8992955bbae1 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:36:26.715022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-520a0e77-0e0b-4262-a4e0-d78165cff4ff tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/0ecd7411-984d-4d4c-b1f8-5c575211619d" status: 202 len: 0 microversion: 2.1 time: 0.221074 Sep 09 06:36:26.715893 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 444/876] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:36:26 2022] DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments/0ecd7411-984d-4d4c-b1f8-5c575211619d => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:26.848826 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12b4fc4-0305-4f63-94a7-5065cbcb0131", "name": "network-vif-deleted", "tag": "5b26d108-0a54-4684-a651-7c4059439a0e"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:26.861978 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:26.862576 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:26.863104 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:26.879301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] Creating event network-vif-deleted:5b26d108-0a54-4684-a651-7c4059439a0e for instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 on hv-cinder-85220 Sep 09 06:36:26.885834 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-5bc7fabe-ad7a-4c17-a236-2cc9ed0ba9f0 req-8effbf72-b078-4cf9-b68d-4cce9162cf78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041713 Sep 09 06:36:26.886750 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 433/877] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:27.350371 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:27.351076 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:27.360921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:27.361452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:27.361848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:27.362856 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:27.363319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:27.363887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:27.400956 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:27.401443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:27.401868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:27.402312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lazy-loading 'fault' on Instance uuid c12b4fc4-0305-4f63-94a7-5065cbcb0131 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:36:27.447718 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d5f23bd3f4b35a66736d2a6a3c3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ee1a9407994bf9a624e6231c7fe565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:27.456314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a851a0c0-1515-4b70-b6db-20106e9eb62a tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 200 len: 1331 microversion: 2.1 time: 0.110913 Sep 09 06:36:27.456904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 445/878] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:27 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:27.914687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:27.917031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:27.925146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:27.925641 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:27.926082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:27.926788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:27.927247 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:27.927700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:27.958185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-863dbfef-9568-4351-a23f-cbcc177e7d52 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048003 Sep 09 06:36:27.962714 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 434/879] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:27 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:36:28.077782 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:28.080447 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:28.086413 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.086903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.087340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.088060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.088527 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.088954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.119047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4cf7ee42-7c04-4af3-9a78-93a97829ea57 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045238 Sep 09 06:36:28.119628 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 446/880] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:36:28 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:36:28.195208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:28.195745 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:28.201656 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.202145 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.202580 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.203515 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.204014 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.204440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.229328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:36:28.303094 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-709746c1-41cf-4973-b676-246751ae205e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 204 len: 0 microversion: 2.1 time: 0.111314 Sep 09 06:36:28.303705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 435/881] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:28 2022] DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:36:28.314806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:28.315337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:28.321346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.321827 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.322255 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.322933 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.323388 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.323838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.455866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:28.463710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-216089be-4f88-4e1a-a553-acf4cb056133 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1675 microversion: 2.1 time: 0.153631 Sep 09 06:36:28.464272 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 447/882] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:28 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:28.482127 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:28.482830 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:28.489565 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.490053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.490490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.491175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:28.491665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:28.492091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:28.506367 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 HTTP/1.1 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:28.508038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:28.509741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'c12b4fc4-0305-4f63-94a7-5065cbcb0131'} Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:28.510865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:28.512451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:28.514196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:28.514196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-729f3c6e-a040-405c-88ba-624c2ea5516f tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 404 len: 111 microversion: 2.1 time: 0.031460 Sep 09 06:36:28.514196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 436/883] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:28 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:28.518158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9451ff78-2829-476a-96b7-90a7fcaf9323 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '.version_select at 0x7f74acf8f430>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:28.536359 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9451ff78-2829-476a-96b7-90a7fcaf9323 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858328277" status: 202 len: 0 microversion: 2.1 time: 0.022076 Sep 09 06:36:28.536961 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 448/884] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 9 06:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858328277 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:29.487290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:29.487925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:29.494175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:29.494652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:29.495074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:29.495788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:29.496233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:29.496654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:29.499256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:29.636457 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:29.644477 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-363ca55d-7aba-4335-81bb-da02c280ca28 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1675 microversion: 2.1 time: 0.161400 Sep 09 06:36:29.645027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 437/885] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:29 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:30.295751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:30.296246 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:30.302581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.303178 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.303766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.304477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.304947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.305372 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.319887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 HTTP/1.1 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:30.321564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.322963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'c12b4fc4-0305-4f63-94a7-5065cbcb0131'} Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:30.324310 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.325783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.327872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:30.327872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-c482d313-da62-400f-8724-2d6c9e69b570 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 404 len: 111 microversion: 2.1 time: 0.031710 Sep 09 06:36:30.327872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 449/886] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:30 2022] DELETE /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:30.332998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:30.333615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: c12b4fc4-0305-4f63-94a7-5065cbcb0131] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:30.339518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.340043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.340793 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.341231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.341833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.342284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.356085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 HTTP/1.1 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:30.357650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.360892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'c12b4fc4-0305-4f63-94a7-5065cbcb0131'} Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:30.362026 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. Sep 09 06:36:30.364259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:30.365943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance c12b4fc4-0305-4f63-94a7-5065cbcb0131 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:30.365943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e32b2354-45f5-4c3b-b60e-45df15bb6def tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131" status: 404 len: 111 microversion: 2.1 time: 0.029931 Sep 09 06:36:30.365943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 438/887] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:30 2022] GET /compute/v2.1/servers/c12b4fc4-0305-4f63-94a7-5065cbcb0131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:36:30.668360 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:30.669068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:30.677618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.678285 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.678752 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.679877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:30.680534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:30.681159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:30.873838 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ccfec70340c797ecba83163ff1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a732015d4244c378e0204e1d216f57b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:30.876812 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:30.883781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cb51f06f-b619-4c89-9a6a-86e20b2cfa76 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 200 len: 1675 microversion: 2.1 time: 0.219463 Sep 09 06:36:30.884351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 450/888] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:30 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:31.182925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2516d5f-2633-4271-b038-8992955bbae1", "name": "network-vif-deleted", "tag": "8d536160-685a-4a21-ade7-c13d278af1b5"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:31.195353 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.196134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.196797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.209719 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] Creating event network-vif-deleted:8d536160-685a-4a21-ade7-c13d278af1b5 for instance d2516d5f-2633-4271-b038-8992955bbae1 on hv-cinder-85220 Sep 09 06:36:31.214387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-8677fb38-846b-4fb0-8910-55153819980a req-7bfe355e-1988-4f46-b269-c7b6b659ecba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035415 Sep 09 06:36:31.214970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 439/889] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:31.508998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.509533 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:31.516376 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.516864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.517293 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.517976 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.518428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.518846 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.532979 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb HTTP/1.1 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:31.534646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.536269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '9c7eb260-2b49-4a8f-bf7b-6098b136a4bb'} Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:31.537081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.538381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.539661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:31.539661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0f864588-e0ae-4371-a8b3-da9e5e61c5e8 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 404 len: 111 microversion: 2.1 time: 0.031891 Sep 09 06:36:31.539661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 451/890] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:31 2022] DELETE /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:31.545399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.546098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:31.553506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.554113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.554654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.555356 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.556436 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.556873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.571615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb HTTP/1.1 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:31.573480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.575230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '9c7eb260-2b49-4a8f-bf7b-6098b136a4bb'} Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:31.579245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. Sep 09 06:36:31.580774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.582120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 9c7eb260-2b49-4a8f-bf7b-6098b136a4bb could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:31.582120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-665d37f5-ef2d-4c02-8b44-ac2550531e26 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb" status: 404 len: 111 microversion: 2.1 time: 0.033803 Sep 09 06:36:31.582120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 440/891] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:31 2022] GET /compute/v2.1/servers/9c7eb260-2b49-4a8f-bf7b-6098b136a4bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:31.583707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.584199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:31.590138 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.590627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.591058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.591774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.592231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.592648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.606661 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 HTTP/1.1 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:31.608226 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.610690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'af89a0ac-56b7-4efa-aa9b-69e8c6b358c2'} Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:31.611588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.612943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.614888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:31.614888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7fe86e76-0fa7-4f82-bda4-6c94d042ee2b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 404 len: 111 microversion: 2.1 time: 0.030363 Sep 09 06:36:31.614888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 452/892] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:31 2022] DELETE /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:31.620142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.620866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: af89a0ac-56b7-4efa-aa9b-69e8c6b358c2] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:31.627476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.628037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.628651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.629443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.630011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.630780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.644869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 HTTP/1.1 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:31.646505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.648259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'af89a0ac-56b7-4efa-aa9b-69e8c6b358c2'} Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:31.649178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. Sep 09 06:36:31.650758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.652248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:31.652248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d4dd71d4-f80d-45c7-b4ae-5d934269ed05 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2" status: 404 len: 111 microversion: 2.1 time: 0.032236 Sep 09 06:36:31.652248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 441/893] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:31 2022] GET /compute/v2.1/servers/af89a0ac-56b7-4efa-aa9b-69e8c6b358c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:31.907348 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.908140 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:31.914580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.914957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.915460 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.916314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:31.916856 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:31.917284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:31.931863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 HTTP/1.1 Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:31.933464 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:31.935520 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'd2516d5f-2633-4271-b038-8992955bbae1'} Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:31.936786 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:31.939070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:31.940957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:31.940957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9da73e52-d4b4-44b0-b857-e9f7c4d8031e tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 404 len: 111 microversion: 2.1 time: 0.031641 Sep 09 06:36:31.940957 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 453/894] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:31 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:31.946831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-991ad00d-b19e-4f06-aa5b-5816df828b1a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '.version_select at 0x7f74aceee940>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:31.967069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-991ad00d-b19e-4f06-aa5b-5816df828b1a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043807172" status: 202 len: 0 microversion: 2.1 time: 0.025509 Sep 09 06:36:31.967663 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 442/895] 10.222.0.25 () {58 vars in 1221 bytes} [Fri Sep 9 06:36:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2043807172 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:32.800871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:32.801411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:32.808328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:32.808795 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:32.809236 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:32.809958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:32.810420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:32.810843 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:32.824378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc HTTP/1.1 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:32.826473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.828756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '1032ded3-aab9-4275-bad0-aef089a44bdc'} Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:32.829671 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.831202 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.832814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:32.832814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9888fc86-4f3b-4c5f-827e-30e2fb28c55b tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 404 len: 111 microversion: 2.1 time: 0.032074 Sep 09 06:36:32.832814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 454/896] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:32 2022] DELETE /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:32.837750 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:32.838358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] [instance: 1032ded3-aab9-4275-bad0-aef089a44bdc] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:32.846380 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:32.847186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:32.847673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:32.848469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:32.849016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:32.849497 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:32.864687 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] HTTP exception thrown: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Request method failure captured: Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc HTTP/1.1 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1JYCVomHyKDy6R_myzfUBDaPUtvTtuQfRcmEriwxVAjqcqAQ5CqrRBs6_Kgc_axQiHXAV_jjj9nFzk7LTJW_l0Yn1zbDVQ7R4Z32ZMBxnygLVnnbBTsYaAF_RnU0UKPLI8kl_ZeSc8uFT3FvaLoA2eEkUKgLdYnDDdqCkn05QE_-M Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:32.866281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e8ee1a9407994bf9a624e6231c7fe565"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: e8ee1a9407994bf9a624e6231c7fe565 Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-690253568 Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 925d5f23bd3f4b35a66736d2a6a3c3eb Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeNegativeTest-690253568-project Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.867972 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '1032ded3-aab9-4275-bad0-aef089a44bdc'} Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:32.872258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. Sep 09 06:36:32.873903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:32.875443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] Returning 404 to user: Instance 1032ded3-aab9-4275-bad0-aef089a44bdc could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:32.875443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-aa9021ad-0aaf-4fb9-b78d-7887c829a957 tempest-AttachVolumeNegativeTest-690253568 tempest-AttachVolumeNegativeTest-690253568-project] 10.222.0.25 "GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc" status: 404 len: 111 microversion: 2.1 time: 0.034567 Sep 09 06:36:32.875443 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 443/897] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:32 2022] GET /compute/v2.1/servers/1032ded3-aab9-4275-bad0-aef089a44bdc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:34.908841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:34.910186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:34.918613 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:34.919227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:34.919780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:34.920576 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:34.921094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:34.921694 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:34.940017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 HTTP/1.1 Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:34.941758 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.943180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'd2516d5f-2633-4271-b038-8992955bbae1'} Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:34.944237 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.945518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.946794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:34.946794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-15795001-9429-48e5-a36e-887caa03d54a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 404 len: 111 microversion: 2.1 time: 0.039827 Sep 09 06:36:34.948067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 455/898] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:34 2022] DELETE /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:36:34.954013 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:34.954785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: d2516d5f-2633-4271-b038-8992955bbae1] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:34.965045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:34.965660 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:34.966178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:34.966959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:34.967489 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:34.968734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:34.985505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 HTTP/1.1 Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:34.987066 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.988684 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'd2516d5f-2633-4271-b038-8992955bbae1'} Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:34.989681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. Sep 09 06:36:34.991280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:34.992916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance d2516d5f-2633-4271-b038-8992955bbae1 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:34.992916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7ce8328c-02c5-4598-a8ba-3e7c82a4d15a tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1" status: 404 len: 111 microversion: 2.1 time: 0.039601 Sep 09 06:36:34.992916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 444/899] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:34 2022] GET /compute/v2.1/servers/d2516d5f-2633-4271-b038-8992955bbae1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:37.369350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b4324e58-39f7-40ec-8ae7-e32fdad2bf88 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Action: 'create', calling method: .version_select at 0x7f74ad5d0e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1146479277", "metadata": {"Type": "work"}}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b4324e58-39f7-40ec-8ae7-e32fdad2bf88 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 122 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:37.401663 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1146479277", "metadata": {"Type": "work"}}} Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:37.403322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1146479277', 'metadata': {'Type': 'work'}}}} Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise error Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.404381 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 06:36:37.406245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 06:36:37.407871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 06:36:37.407871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.407871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b4324e58-39f7-40ec-8ae7-e32fdad2bf88 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.407871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b4324e58-39f7-40ec-8ae7-e32fdad2bf88 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.148016 Sep 09 06:36:37.407871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 456/900] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 9 06:36:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:37.412818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e5bdd53d-0926-466b-b845-09c0ae456539 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Action: 'create', calling method: .version_select at 0x7f74acf4c9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1245318340", "metadata": {"Type": "work"}}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e5bdd53d-0926-466b-b845-09c0ae456539 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 120 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:37.417360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1245318340", "metadata": {"Type": "work"}}} Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: Sep 09 06:36:37.419037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1245318340', 'metadata': {'Type': 'work'}}}} Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise error Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi '0' Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.420058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 06:36:37.423279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 06:36:37.424780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 06:36:37.424780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.424780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e5bdd53d-0926-466b-b845-09c0ae456539 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.424780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e5bdd53d-0926-466b-b845-09c0ae456539 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009702 Sep 09 06:36:37.424780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 445/901] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 9 06:36:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:37.428169 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d45b4e4-6abc-410e-aa3a-0db75596e641 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Action: 'create', calling method: .version_select at 0x7f74ad03c5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-498259337", "metadata": {"Type": "work"}}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d45b4e4-6abc-410e-aa3a-0db75596e641 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 118 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:37.432615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-498259337", "metadata": {"Type": "work"}}} Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:37.434190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-498259337', 'metadata': {'Type': 'work'}}}} Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise error Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi '' Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.435180 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 06:36:37.436978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 06:36:37.439242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 06:36:37.439242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.439242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8d45b4e4-6abc-410e-aa3a-0db75596e641 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.439242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8d45b4e4-6abc-410e-aa3a-0db75596e641 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009555 Sep 09 06:36:37.439242 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 457/902] 10.222.0.25 () {60 vars in 1156 bytes} [Fri Sep 9 06:36:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:37.443973 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e1b4069-00ce-43fc-a2c5-b58440c98809 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Calling method '.version_select at 0x7f74acf934c0>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:37.474157 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-4e1b4069-00ce-43fc-a2c5-b58440c98809 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] HTTP exception thrown: Volume tempest-invalid-1250134022 could not be found. Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e1b4069-00ce-43fc-a2c5-b58440c98809 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1250134022 HTTP/1.1 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:37.476118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Volume tempest-invalid-1250134022 could not be found. Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'tempest-invalid-1250134022'} Sep 09 06:36:37.477841 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1250134022 could not be found. (HTTP 404) (Request-ID: req-652e16e6-dc7b-4c7f-9f99-dca71e4bfeb6) Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.478849 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:37.480368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1250134022 could not be found. Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:37.481871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1250134022 could not be found. Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1250134022 could not be found. Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4e1b4069-00ce-43fc-a2c5-b58440c98809 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 404 to user: Volume tempest-invalid-1250134022 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4e1b4069-00ce-43fc-a2c5-b58440c98809 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1250134022" status: 404 len: 99 microversion: 2.1 time: 0.037879 Sep 09 06:36:37.483408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 446/903] 10.222.0.25 () {58 vars in 1218 bytes} [Fri Sep 9 06:36:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1250134022 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 09 06:36:37.487621 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-db76dc8a-5c17-4599-9fc0-f8aba1dddbac tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004254 Sep 09 06:36:37.488112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 458/904] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 9 06:36:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 06:36:37.495965 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1a84be68-075d-4050-8a46-542ae6bdd39d tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003548 Sep 09 06:36:37.496451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 447/905] 10.222.0.25 () {58 vars in 1137 bytes} [Fri Sep 9 06:36:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 06:36:37.505511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43179ee4-0627-4b58-907a-e54210adfafb tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Calling method '.version_select at 0x7f74ad02d4c0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:37.533302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-43179ee4-0627-4b58-907a-e54210adfafb tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] HTTP exception thrown: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43179ee4-0627-4b58-907a-e54210adfafb tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/os-volumes/0deade56-c7ce-422d-a945-1f37a226fdb1 HTTP/1.1 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:37.536463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '0deade56-c7ce-422d-a945-1f37a226fdb1'} Sep 09 06:36:37.538069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. (HTTP 404) (Request-ID: req-e85962c8-79be-4f0b-bee9-f3334fb4eeed) Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.539031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:37.540497 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 06:36:37.541784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43179ee4-0627-4b58-907a-e54210adfafb tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 404 to user: Volume 0deade56-c7ce-422d-a945-1f37a226fdb1 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-43179ee4-0627-4b58-907a-e54210adfafb tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/0deade56-c7ce-422d-a945-1f37a226fdb1" status: 404 len: 109 microversion: 2.1 time: 0.036084 Sep 09 06:36:37.548648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 459/906] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:36:37 2022] DELETE /compute/v2.1/os-volumes/0deade56-c7ce-422d-a945-1f37a226fdb1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:37.549699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-38ec2de2-4676-4182-b1ea-ae5d08909050 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Calling method '.version_select at 0x7f74ad067f70>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:37.576716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-38ec2de2-4676-4182-b1ea-ae5d08909050 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] HTTP exception thrown: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-38ec2de2-4676-4182-b1ea-ae5d08909050 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Request method failure captured: Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/os-volumes/2ed7269d-ee18-4c42-9583-298f18db49ad HTTP/1.1 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt71fPhOuibVEAj64TjWmapFOCWLPELMPTPRbFop-B6vm6oNyZiu0bpHrrxkMSh8W-hR-oLJT1gVQG5ViVhAPWzpxL0LJ8i6NCWy0lPgtsmTI8PrTlQW3Z-AiXed34sNoKYndgUcSHRSS_D6tAWVFb9GMC3La_THFtU21DOskilnDAE Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:37.578851 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/26a6d8329ea74a779407f080c1fc8338"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 26a6d8329ea74a779407f080c1fc8338 Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-VolumesNegativeTest-1972389382 Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: f6050f459a184bc0ae9739cb052b729d Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-VolumesNegativeTest-1972389382-project Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '2ed7269d-ee18-4c42-9583-298f18db49ad'} Sep 09 06:36:37.580490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. (HTTP 404) (Request-ID: req-06391a31-da0e-45d9-b98f-ad6b0142bd70) Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.581514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:37.582917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 06:36:37.584318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-38ec2de2-4676-4182-b1ea-ae5d08909050 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] Returning 404 to user: Volume 2ed7269d-ee18-4c42-9583-298f18db49ad could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-38ec2de2-4676-4182-b1ea-ae5d08909050 tempest-VolumesNegativeTest-1972389382 tempest-VolumesNegativeTest-1972389382-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2ed7269d-ee18-4c42-9583-298f18db49ad" status: 404 len: 109 microversion: 2.1 time: 0.036206 Sep 09 06:36:37.585718 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 448/907] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:37 2022] GET /compute/v2.1/os-volumes/2ed7269d-ee18-4c42-9583-298f18db49ad => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:37.983482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:37.987803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:37.998136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:37.998605 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:37.999321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.000702 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.001428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.002088 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.048432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac6e9b7f-dfac-4cf9-b3da-f9fe2364273c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074157 Sep 09 06:36:38.049300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 460/908] 10.222.0.25 () {60 vars in 1343 bytes} [Fri Sep 9 06:36:37 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:38.122895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:38.128021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:38.138441 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.138944 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.139384 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.140277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.140741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.141166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.177455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:36:38.261862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:38.262736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:38.271273 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.272104 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.273417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-302dec40-b35c-4a66-8302-c51c812c85c3 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 204 len: 0 microversion: 2.20 time: 0.155286 Sep 09 06:36:38.274053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 449/909] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 9 06:36:38 2022] DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 06:36:38.285355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.286434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.286995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:38.287837 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:38.288563 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.289635 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.295669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.296268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.297353 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.298321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.299269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.299825 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.310609 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff HTTP/1.1 Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:38.313253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.314926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'ebebb1d1-2de0-4afb-b816-797f5a4ed1ff'} Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:38.315880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.317373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.320199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:38.321392 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b8d789a7-16c2-4014-849a-285ecf0a0fc7 tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 404 len: 111 microversion: 2.1 time: 0.063959 Sep 09 06:36:38.325135 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 461/910] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:36:38 2022] DELETE /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:38.330225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:38.331206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] [instance: ebebb1d1-2de0-4afb-b816-797f5a4ed1ff] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:38.337448 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.338134 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.338822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.339528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:38.340037 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:38.340434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:38.357483 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] HTTP exception thrown: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Request method failure captured: Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff HTTP/1.1 Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1Dqfn-9avUfh7jlpmazgSyHko0d2KCVgVSEfldknB9BCArU7gyJA6n-H9O0Q5LFmuVxuer-WOuzh0V8nlL93jdE0DXYnTccwkYy8e5qNVGpaOBmtAz_Y657qk9Fs1G-rJK5BhhdUzZ436tjeStJ5r9lBaR0fdI7Jvkb2N8AsEeXEc Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:38.359637 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7a732015d4244c378e0204e1d216f57b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7a732015d4244c378e0204e1d216f57b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7a732015d4244c378e0204e1d216f57b Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1732845571 Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 1c86ccfec70340c797ecba83163ff1a2 Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeTestJSON-1732845571-project Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.361225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'ebebb1d1-2de0-4afb-b816-797f5a4ed1ff'} Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:38.361982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. Sep 09 06:36:38.363268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:38.364421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] Returning 404 to user: Instance ebebb1d1-2de0-4afb-b816-797f5a4ed1ff could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:38.364421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-410a1106-f488-4e58-9758-90ca6bca5d1f tempest-AttachVolumeTestJSON-1732845571 tempest-AttachVolumeTestJSON-1732845571-project] 10.222.0.25 "GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff" status: 404 len: 111 microversion: 2.1 time: 0.034774 Sep 09 06:36:38.364421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 462/911] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:38 2022] GET /compute/v2.1/servers/ebebb1d1-2de0-4afb-b816-797f5a4ed1ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:38.519334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:38.532083 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:38.535566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:38.539506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8669d905-5de1-42ae-86f7-dae068a3820c tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.260118 Sep 09 06:36:38.540639 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 450/912] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:38 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:36:39.566253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:39.566864 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:39.573745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:39.574232 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:39.574667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:39.575374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:39.575858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:39.576544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:39.760389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:39.773844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:39.776444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:39.778301 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-bbb08e58-ecab-43b7-8e40-d6e5a3fdaf66 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1722 microversion: 2.20 time: 0.215895 Sep 09 06:36:39.779235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 463/913] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:39 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:40.809170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:40.809776 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:40.820352 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:40.820898 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:40.821291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:40.822006 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:40.822469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:40.822897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:40.824565 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1777439525", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2075716063", "security_groups": [{"name": "tempest-secgroup-smoke-959218854"}], "block_device_mapping_v2": [{"uuid": "2bb9ef1f-2902-429c-88b8-1f22919be20f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7964840-3c67-4db0-a5fd-d0b8ff555b07"}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:41.002741 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:41.011888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:41.020533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:41.021746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-60651bf9-ecaf-4be3-a283-7277a062eb14 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1655 microversion: 2.20 time: 0.216748 Sep 09 06:36:41.022299 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 451/914] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:40 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1655 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 06:36:41.113167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] validate_networks() for [('a7964840-3c67-4db0-a5fd-d0b8ff555b07', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:36:41.552788 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddc6991-2ae2-4350-be11-5f9255eeeba7", "name": "network-vif-deleted", "tag": "1fe82534-03c6-4afc-bbb7-4a572384fb55"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:41.583062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:41.583890 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:41.585045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:41.600123 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] Creating event network-vif-deleted:1fe82534-03c6-4afc-bbb7-4a572384fb55 for instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 on hv-cinder-85220 Sep 09 06:36:41.605907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-a1b60496-58be-4254-bf3a-094f7f555bab req-35f64c49-2914-4ae0-aab3-f979fc23738d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057028 Sep 09 06:36:41.607950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 452/915] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:41.837898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:36:41.839186 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:36:41.839833 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:36:41.840271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:36:41.840685 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:36:41.877650 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:41.878351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:41.878798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:41.879635 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:41.883949 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:41.885653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:41.918996 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:36:41.924883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Getting quotas for user 472b6623f57a41568fe7ffce8e40e350 and project 09397aeb58f44f7c9f0ab921e471079a. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:36:42.012660 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:36:42.016932 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bb9ef1f-2902-429c-88b8-1f22919be20f',volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:36:42.049998 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:42.050804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:42.066315 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:42.066858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:42.067306 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:42.070721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:42.071440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:42.072056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:42.155074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:42.157208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:42.158122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:42.159504 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lazy-loading 'fault' on Instance uuid 6ddc6991-2ae2-4350-be11-5f9255eeeba7 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:36:42.278682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f033fc30-c74a-4bbe-bc32-6da32b881852 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.458420 Sep 09 06:36:42.279682 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 464/916] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:36:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 06:36:42.308002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0017e6d4-d6e3-40b9-b5b8-0745bb156bc9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:42.310225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0017e6d4-d6e3-40b9-b5b8-0745bb156bc9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:42.393496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:42.416572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:42.423632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a6757e5408e40cc85ad6145064d8ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5de98a77f64cd5beeab6865f5ea7c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:42.426764 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-de41d6c7-1cdd-4340-8623-7c967787d60e tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 200 len: 1372 microversion: 2.20 time: 0.382564 Sep 09 06:36:42.431607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0017e6d4-d6e3-40b9-b5b8-0745bb156bc9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:42.432187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 453/917] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:42 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 1372 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 06:36:42.444575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0017e6d4-d6e3-40b9-b5b8-0745bb156bc9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1095 microversion: 2.1 time: 0.148049 Sep 09 06:36:42.451768 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 465/918] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:42 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1095 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:43.457175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:43.458386 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:43.469265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:43.470510 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:43.478775 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:43.480309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:43.480844 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:43.482269 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:43.483011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:43.483563 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:43.484324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:43.485046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:43.485351 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:43.490170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:43.490651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:43.491087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:43.504149 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 HTTP/1.1 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:43.505807 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:43.507275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '6ddc6991-2ae2-4350-be11-5f9255eeeba7'} Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:43.508087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:43.509359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:43.510573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:43.510573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0a82b78a-1343-4e90-a38d-df7882b063fe tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 404 len: 111 microversion: 2.20 time: 0.054658 Sep 09 06:36:43.518074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 454/919] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:43 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 09 06:36:43.527712 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2193fb1e-920b-418f-a53d-d4d01f2c3042 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '.version_select at 0x7f74acfb9f70>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:43.557743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2193fb1e-920b-418f-a53d-d4d01f2c3042 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456422382" status: 204 len: 0 microversion: 2.20 time: 0.034426 Sep 09 06:36:43.559466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 455/920] 10.222.0.25 () {60 vars in 1262 bytes} [Fri Sep 9 06:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456422382 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 06:36:43.594319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:43.603778 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-90537c44-36d0-4560-af50-b0410da311c1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1193 microversion: 2.1 time: 0.138938 Sep 09 06:36:43.604917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 466/921] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:43 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1193 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:36:44.632289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:44.632953 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:44.644163 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:44.644666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:44.645101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:44.646261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:44.646722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:44.649341 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:44.805884 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1e48c37c-a7c7-4018-9ff2-5a4aa2364252 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Action: 'create', calling method: .version_select at 0x7f74aceeec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1018642518"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:45.085889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:45.102751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ffcd10fc-560c-45ce-9c3a-1d13ba096d60 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1278 microversion: 2.1 time: 0.475374 Sep 09 06:36:45.103607 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 467/922] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:44 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1278 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:36:45.266638 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1e48c37c-a7c7-4018-9ff2-5a4aa2364252 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.697310 Sep 09 06:36:45.267348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 456/923] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Sep 9 06:36:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 09 06:36:45.280379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-719344b6-9a80-4bdf-8169-39c8d8765478 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad09ea60>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:45.349862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-719344b6-9a80-4bdf-8169-39c8d8765478 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 200 len: 345 microversion: 2.1 time: 0.073200 Sep 09 06:36:45.351908 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 468/924] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:45 2022] GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:45.875088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e820aa70-b6d5-402e-8756-7cf97e6a4470", "tag": "573ec978-54c6-4cc6-bf36-204feb7eff85"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:45.885100 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:45.885732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:45.886241 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:45.897450 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] Creating event network-changed:573ec978-54c6-4cc6-bf36-204feb7eff85 for instance e820aa70-b6d5-402e-8756-7cf97e6a4470 on hv-cinder-85220 Sep 09 06:36:45.902258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-dd82c393-60d9-4561-bda9-d9379ffbffaf req-6b98f2a0-af20-4f6e-bbfe-0f4853202849 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036894 Sep 09 06:36:45.903266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 457/925] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:45.997103 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:45.997611 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:46.004519 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.005015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.005453 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.006155 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.006612 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.007035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.022249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 HTTP/1.1 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:46.023868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.025618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '6ddc6991-2ae2-4350-be11-5f9255eeeba7'} Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:46.026467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.027926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.029320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:46.029320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-17421391-5548-479d-bc9b-d9b6d3818d57 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 404 len: 111 microversion: 2.20 time: 0.032878 Sep 09 06:36:46.029320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 469/926] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 9 06:36:45 2022] DELETE /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:46.037447 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.038230 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 6ddc6991-2ae2-4350-be11-5f9255eeeba7] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:46.048122 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.048697 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.049220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.050063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.050882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.051451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.067041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 HTTP/1.1 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:46.068702 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.070425 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '6ddc6991-2ae2-4350-be11-5f9255eeeba7'} Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:46.074560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. Sep 09 06:36:46.076201 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:46.077619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 6ddc6991-2ae2-4350-be11-5f9255eeeba7 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:46.077619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-272b6081-f96f-4ec5-b75a-6ce0fce7bfae tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7" status: 404 len: 111 microversion: 2.20 time: 0.037919 Sep 09 06:36:46.077619 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 458/927] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/servers/6ddc6991-2ae2-4350-be11-5f9255eeeba7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:46.127534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.128159 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:46.135126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.135126 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.138014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.138710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:46.139176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:46.139651 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:46.351760 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:46.359767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-854fffba-0d56-4b02-a3ba-5c7d873202a7 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.236076 Sep 09 06:36:46.360336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 470/928] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:46.363744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ab0d874d-b954-40d9-8b2f-b2bda7d06ca7 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acea0b80>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.423224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ab0d874d-b954-40d9-8b2f-b2bda7d06ca7 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 200 len: 346 microversion: 2.1 time: 0.063467 Sep 09 06:36:46.423806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 459/929] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:46.437017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a88abdb5-3829-4e90-8790-c192b5c6c079 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Action: 'create', calling method: .version_select at 0x7f74ad01a310>, body: {"snapshot": {"volume_id": "178ae9a8-ec4f-454a-957e-a0c8cc74a70b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-587334706"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:46.591194 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a88abdb5-3829-4e90-8790-c192b5c6c079 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158061 Sep 09 06:36:46.595583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 471/930] 10.222.0.25 () {60 vars in 1162 bytes} [Fri Sep 9 06:36:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:46.603696 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8b2a5176-f457-4246-bd89-f3b050977b86 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad07f700>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.637417 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8b2a5176-f457-4246-bd89-f3b050977b86 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 286 microversion: 2.1 time: 0.037466 Sep 09 06:36:46.637989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 460/931] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:46.649747 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-42189f78-37ac-4077-9620-323b699bb481 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf78e50>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.680552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-42189f78-37ac-4077-9620-323b699bb481 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034729 Sep 09 06:36:46.681122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 472/932] 10.222.0.25 () {58 vars in 1140 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:46.693203 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0f03aa9c-50f7-4955-9ae0-aa10b6a0decb tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf4cb80>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:46.724389 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0f03aa9c-50f7-4955-9ae0-aa10b6a0decb tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 286 microversion: 2.1 time: 0.034955 Sep 09 06:36:46.724968 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 461/933] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:46 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:47.226019 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:47.226537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:47.232485 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.232971 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.233406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.234586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.235040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.235460 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.248210 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 HTTP/1.1 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:47.250409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.252136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '1eaf1d52-f6aa-4028-ab06-e1efaefeec15'} Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:47.253150 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.254644 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.256501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:47.256501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-012730dc-a98b-408e-89c7-73f67a6b3c13 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 404 len: 111 microversion: 2.20 time: 0.031032 Sep 09 06:36:47.256501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 473/934] 10.222.0.25 () {60 vars in 1280 bytes} [Fri Sep 9 06:36:47 2022] DELETE /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:47.260668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:47.261274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] [instance: 1eaf1d52-f6aa-4028-ab06-e1efaefeec15] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:47.267431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.267953 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.268385 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.269069 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.269525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.269947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.282874 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] HTTP exception thrown: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Request method failure captured: Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 HTTP/1.1 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt1GG38zcXL3Rul2piFJuaLgKiqpXZqzR02xcjEVgROClTGQJJvfATf2dEQvu9qte18e1KT9aydkbPzd-w50OoDXy4BVbP1k8SP_xkY3R_2AiCxPVk0M9aN1WkOi_ZemL-2UtKpQ5IYBBk6tSZGPz0_Nkm-k2x3atglKKqONiEjb_KM Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:47.284398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7d5de98a77f64cd5beeab6865f5ea7c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 7d5de98a77f64cd5beeab6865f5ea7c2 Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1812188542 Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 0a6757e5408e40cc85ad6145064d8ba7 Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1812188542-project Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.286137 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '1eaf1d52-f6aa-4028-ab06-e1efaefeec15'} Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:47.286996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. Sep 09 06:36:47.288274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:47.289383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] Returning 404 to user: Instance 1eaf1d52-f6aa-4028-ab06-e1efaefeec15 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:47.289383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-348d41b1-61ac-49db-be04-492383fbcc95 tempest-AttachVolumeShelveTestJSON-1812188542 tempest-AttachVolumeShelveTestJSON-1812188542-project] 10.222.0.25 "GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15" status: 404 len: 111 microversion: 2.20 time: 0.029377 Sep 09 06:36:47.289383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 462/935] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Sep 9 06:36:47 2022] GET /compute/v2.1/servers/1eaf1d52-f6aa-4028-ab06-e1efaefeec15 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 06:36:47.384336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:47.385048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:47.392000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.392000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.392277 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.392945 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:47.393406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:47.393834 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:47.607241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:47.615942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d7a8c2d8-98ab-458c-9e92-7dab1423d182 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.235374 Sep 09 06:36:47.616516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 474/936] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:47 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:47.737940 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b48daaf7-5e55-44fe-a289-f6b9ef30b45c tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf4cc10>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:47.768694 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b48daaf7-5e55-44fe-a289-f6b9ef30b45c tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 286 microversion: 2.1 time: 0.035353 Sep 09 06:36:47.769261 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 463/937] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:47 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:48.638483 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:48.639004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:48.645747 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:48.646178 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:48.646612 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:48.647311 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:48.647875 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:48.648312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:48.782319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-91057e8a-e77d-4522-a603-777d48acd696 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf26820>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:48.818481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-91057e8a-e77d-4522-a603-777d48acd696 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 286 microversion: 2.1 time: 0.040773 Sep 09 06:36:48.819078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 464/938] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:48 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:36:48.868225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:48.876930 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-dca632c7-9b76-468a-b57c-3db2d88cf85a tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.242430 Sep 09 06:36:48.877498 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 475/939] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:48 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:49.831110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-940a216c-e77a-4520-8fc3-75f7fe500a89 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf363a0>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:49.863603 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-940a216c-e77a-4520-8fc3-75f7fe500a89 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 287 microversion: 2.1 time: 0.037082 Sep 09 06:36:49.864344 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 465/940] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:49 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:49.876835 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-285ce9bc-5daa-4a0c-a39a-ae7e778643e0 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad02d790>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:49.902477 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:49.903624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:49.910411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:49.911117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:49.912010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:49.912716 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:49.913409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:49.914075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:49.990184 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-285ce9bc-5daa-4a0c-a39a-ae7e778643e0 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 202 len: 0 microversion: 2.1 time: 0.117660 Sep 09 06:36:49.993582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 476/941] 10.222.0.25 () {58 vars in 1254 bytes} [Fri Sep 9 06:36:49 2022] DELETE /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:50.003505 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e5f9de39-c2bc-47fb-93ee-ea4d5d485c03 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acec9280>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:50.052496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e5f9de39-c2bc-47fb-93ee-ea4d5d485c03 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 200 len: 286 microversion: 2.1 time: 0.057538 Sep 09 06:36:50.053064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 477/942] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:49 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:50.132369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:50.141969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-aa90444f-ae52-45ab-9d26-5fb3d7481f9c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.244545 Sep 09 06:36:50.143031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 466/943] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:49 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:51.067315 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b1d4acef-87af-462d-9041-7b4b0ec4ed55 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad03ce50>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:51.093932 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-b1d4acef-87af-462d-9041-7b4b0ec4ed55 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] HTTP exception thrown: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b1d4acef-87af-462d-9041-7b4b0ec4ed55 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Request method failure captured: Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 HTTP/1.1 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt7832ZzSLfN8x_QMVAKGHSDx0kiJjP12gd1bsOCvtANDxqC9Kkosw9XT-uLMVu6r5Y5x-W_x6F8HhpAlRLQuo_d0ut9OhHOFmlWZKYkfLvp14KYbg4NX_dwq_YWTHSm9pBWFqUTQqf-RXrTyVaXqLXwcHGewcveh84lFRyivi_Z_0E Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:51.097028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749eca06a6484ebba440959ae22a5858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749eca06a6484ebba440959ae22a5858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 8e26d2c775eb4b019be065da57ce4999 Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'd6526b5e-9b07-4411-853a-b58f99f6c4c1'} Sep 09 06:36:51.098653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. (HTTP 404) (Request-ID: req-09676fa6-7166-4068-b285-93cf5be3996b) Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.099820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:51.101182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 06:36:51.102493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b1d4acef-87af-462d-9041-7b4b0ec4ed55 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Returning 404 to user: Snapshot d6526b5e-9b07-4411-853a-b58f99f6c4c1 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:51.103847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b1d4acef-87af-462d-9041-7b4b0ec4ed55 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1" status: 404 len: 111 microversion: 2.1 time: 0.037817 Sep 09 06:36:51.104745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 478/944] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:36:51 2022] GET /compute/v2.1/os-snapshots/d6526b5e-9b07-4411-853a-b58f99f6c4c1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:51.113832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a6e79854-03a1-43ee-8271-b3ff47550525 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acfdce50>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:51.166023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:51.166639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:51.173765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:51.174263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:51.176010 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:51.176716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:51.177177 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:51.177601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:51.224917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a6e79854-03a1-43ee-8271-b3ff47550525 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 202 len: 0 microversion: 2.1 time: 0.114581 Sep 09 06:36:51.228506 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 467/945] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:36:51 2022] DELETE /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:36:51.235415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5f0ba86a-52e2-4f48-9f82-639af0e460b4 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad233040>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:51.304840 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5f0ba86a-52e2-4f48-9f82-639af0e460b4 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 200 len: 345 microversion: 2.1 time: 0.070685 Sep 09 06:36:51.309540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 468/946] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:51 2022] GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:51.369020 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:51.379985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-050f2410-7ce2-4e3f-9a7e-329db2f5039d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.217646 Sep 09 06:36:51.381012 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 479/947] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:51 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:36:52.323677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-96af3815-e08e-43f5-a0a0-00b8f7281d32 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74aceae280>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:52.355827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-96af3815-e08e-43f5-a0a0-00b8f7281d32 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] HTTP exception thrown: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-96af3815-e08e-43f5-a0a0-00b8f7281d32 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Request method failure captured: Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b HTTP/1.1 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt7832ZzSLfN8x_QMVAKGHSDx0kiJjP12gd1bsOCvtANDxqC9Kkosw9XT-uLMVu6r5Y5x-W_x6F8HhpAlRLQuo_d0ut9OhHOFmlWZKYkfLvp14KYbg4NX_dwq_YWTHSm9pBWFqUTQqf-RXrTyVaXqLXwcHGewcveh84lFRyivi_Z_0E Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:36:52.358002 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749eca06a6484ebba440959ae22a5858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749eca06a6484ebba440959ae22a5858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 8e26d2c775eb4b019be065da57ce4999 Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '178ae9a8-ec4f-454a-957e-a0c8cc74a70b'} Sep 09 06:36:52.360221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. (HTTP 404) (Request-ID: req-a6ae13d8-0b80-4398-9509-a05c13960092) Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.361266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:52.362717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 06:36:52.364194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-96af3815-e08e-43f5-a0a0-00b8f7281d32 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Returning 404 to user: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-96af3815-e08e-43f5-a0a0-00b8f7281d32 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 404 len: 109 microversion: 2.1 time: 0.041837 Sep 09 06:36:52.365645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 469/948] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:52 2022] GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:52.376550 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7cfc47f3-9199-4ff1-bcc6-330a1fc8cc45 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74acf781f0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:52.384712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:52.404705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:52.405357 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:52.410739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-7cfc47f3-9199-4ff1-bcc6-330a1fc8cc45 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] HTTP exception thrown: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.412081 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:52.412689 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:52.412989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:52.413683 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:52.414140 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:52.414556 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7cfc47f3-9199-4ff1-bcc6-330a1fc8cc45 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Request method failure captured: Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b HTTP/1.1 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt7832ZzSLfN8x_QMVAKGHSDx0kiJjP12gd1bsOCvtANDxqC9Kkosw9XT-uLMVu6r5Y5x-W_x6F8HhpAlRLQuo_d0ut9OhHOFmlWZKYkfLvp14KYbg4NX_dwq_YWTHSm9pBWFqUTQqf-RXrTyVaXqLXwcHGewcveh84lFRyivi_Z_0E Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:52.415045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749eca06a6484ebba440959ae22a5858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749eca06a6484ebba440959ae22a5858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 8e26d2c775eb4b019be065da57ce4999 Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '178ae9a8-ec4f-454a-957e-a0c8cc74a70b'} Sep 09 06:36:52.416745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. (HTTP 404) (Request-ID: req-a8a2fcf5-b0bd-4c52-af08-add2afeee910) Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.417840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 06:36:52.419214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 06:36:52.421307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7cfc47f3-9199-4ff1-bcc6-330a1fc8cc45 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Returning 404 to user: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:52.423065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7cfc47f3-9199-4ff1-bcc6-330a1fc8cc45 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 404 len: 109 microversion: 2.1 time: 0.051007 Sep 09 06:36:52.424547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 480/949] 10.222.0.25 () {58 vars in 1248 bytes} [Fri Sep 9 06:36:52 2022] DELETE /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:52.432380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0a6ad3ad-9a26-4737-9b95-258c035ccbe2 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Calling method '.version_select at 0x7f74ad03c5e0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:52.441129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=8 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:52.478047 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-0a6ad3ad-9a26-4737-9b95-258c035ccbe2 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] HTTP exception thrown: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0a6ad3ad-9a26-4737-9b95-258c035ccbe2 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Request method failure captured: Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b HTTP/1.1 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt7832ZzSLfN8x_QMVAKGHSDx0kiJjP12gd1bsOCvtANDxqC9Kkosw9XT-uLMVu6r5Y5x-W_x6F8HhpAlRLQuo_d0ut9OhHOFmlWZKYkfLvp14KYbg4NX_dwq_YWTHSm9pBWFqUTQqf-RXrTyVaXqLXwcHGewcveh84lFRyivi_Z_0E Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:36:52.480228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_749eca06a6484ebba440959ae22a5858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/749eca06a6484ebba440959ae22a5858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/749eca06a6484ebba440959ae22a5858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 749eca06a6484ebba440959ae22a5858 Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1206747507 Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 8e26d2c775eb4b019be065da57ce4999 Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1206747507-project Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '178ae9a8-ec4f-454a-957e-a0c8cc74a70b'} Sep 09 06:36:52.481901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. (HTTP 404) (Request-ID: req-34beaf0e-b036-4005-a755-14a2d2df1c57) Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.482814 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 06:36:52.484887 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 06:36:52.486089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0a6ad3ad-9a26-4737-9b95-258c035ccbe2 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] Returning 404 to user: Volume 178ae9a8-ec4f-454a-957e-a0c8cc74a70b could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0a6ad3ad-9a26-4737-9b95-258c035ccbe2 tempest-VolumesSnapshotsTestJSON-1206747507 tempest-VolumesSnapshotsTestJSON-1206747507-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b" status: 404 len: 109 microversion: 2.1 time: 0.053680 Sep 09 06:36:52.487428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 481/950] 10.222.0.25 () {58 vars in 1245 bytes} [Fri Sep 9 06:36:52 2022] GET /compute/v2.1/os-volumes/178ae9a8-ec4f-454a-957e-a0c8cc74a70b => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:36:52.590958 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:52.600242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-17ab4f79-4702-48f3-be10-c1a6e96e50d0 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.199343 Sep 09 06:36:52.601185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 470/951] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:52 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:36:53.625896 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:53.626617 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:53.633373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:53.634090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:53.634733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:53.635820 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:53.638017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:53.638489 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:53.833532 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:53.842848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ac5e1b4b-3c14-41f8-af03-a354b9698166 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.221745 Sep 09 06:36:53.843853 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 482/952] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:53 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:54.868019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:54.868645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:54.875743 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:54.876238 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:54.876683 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:54.877405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:54.877899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:54.878264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:55.046234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:55.055657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4a40b1ea-dfa3-477c-beb1-a8d489a44c83 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.191078 Sep 09 06:36:55.056597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 471/953] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:54 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:56.081888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:56.083292 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:56.089614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:56.099276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:56.100458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:56.101740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:56.104673 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:56.105713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:56.107074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:56.159298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e820aa70-b6d5-402e-8756-7cf97e6a4470", "name": "network-vif-plugged", "status": "completed", "tag": "573ec978-54c6-4cc6-bf36-204feb7eff85"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:36:56.174579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:56.176279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:56.178673 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:56.207709 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] Creating event network-vif-plugged:573ec978-54c6-4cc6-bf36-204feb7eff85 for instance e820aa70-b6d5-402e-8756-7cf97e6a4470 on hv-cinder-85220 Sep 09 06:36:56.219914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-7a66c26b-89b0-4cf3-87fe-2f9f0f6ff57f req-a7dc4674-7d9c-4994-afdb-d2a5b997abe1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064282 Sep 09 06:36:56.220522 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 472/954] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:36:56.290015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:56.300039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-97a86764-9714-4acf-bf65-1c9f477c4970 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.223566 Sep 09 06:36:56.301459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 483/955] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:56 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:57.324869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:57.325566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:57.328567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:36:57.333982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:57.334474 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:57.334904 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:57.335804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:57.336311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:57.336937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:57.476525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:57.484657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cb4321b7-d560-4d93-ae57-57e77f2f86d1 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1266 microversion: 2.1 time: 0.163754 Sep 09 06:36:57.485321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 473/956] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:57 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:58.508803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:58.509420 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:58.516151 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:58.516640 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:58.517076 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:58.517766 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:58.518227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:58.518652 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:58.669338 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:58.678798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7eaef159-e470-4728-abfe-6a04984d46fa tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1453 microversion: 2.1 time: 0.173738 Sep 09 06:36:58.679616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 484/957] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:58 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:36:58.704012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:36:58.704764 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:36:58.712107 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:58.712596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:58.713063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:58.713935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:36:58.722657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:36:58.723161 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:36:58.866648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:36:58.874852 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a716f949-c2d5-4d1c-93c2-5736ef62c86c tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1453 microversion: 2.1 time: 0.175676 Sep 09 06:36:58.875531 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 474/958] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:36:58 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:00.727422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e820aa70-b6d5-402e-8756-7cf97e6a4470", "tag": "573ec978-54c6-4cc6-bf36-204feb7eff85"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:00.745597 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:00.746347 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:00.746943 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:00.762090 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] Creating event network-changed:573ec978-54c6-4cc6-bf36-204feb7eff85 for instance e820aa70-b6d5-402e-8756-7cf97e6a4470 on hv-cinder-85220 Sep 09 06:37:00.768136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-d412df59-cc61-43d9-9368-669b797e6c92 req-752d3f96-4d70-49c7-b238-219fce0b52cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044322 Sep 09 06:37:00.768811 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 485/959] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:06.850004 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1775880819", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "networks": [{"uuid": "4db78c28-f49e-4229-95ad-8ceb42e8a419"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:06.916979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] validate_networks() for [('4db78c28-f49e-4229-95ad-8ceb42e8a419', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:37:07.444560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:37:07.444995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:37:07.445468 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:37:07.445875 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:37:07.446286 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:37:07.456009 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:07.456499 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:07.456933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:07.457657 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:07.458114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:07.458536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:07.465296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:07.478887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Getting quotas for project b5ecb76de8c443ba93d919ab2bad03c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:37:07.483491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Getting quotas for user d8de3e1c91e343d6924f7f4ce08bf4e0 and project b5ecb76de8c443ba93d919ab2bad03c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:37:07.494501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:37:07.496833 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:37:07.543907 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-de5e06ee-6556-4801-a7ae-72eb67f3f358 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697816 Sep 09 06:37:07.544819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 475/960] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:37:07.557734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-af21df1f-f9b0-41e7-b4c8-637e6db022ba tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:07.558427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-af21df1f-f9b0-41e7-b4c8-637e6db022ba tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:07.623410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-af21df1f-f9b0-41e7-b4c8-637e6db022ba tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:07.632316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-af21df1f-f9b0-41e7-b4c8-637e6db022ba tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1214 microversion: 2.1 time: 0.079322 Sep 09 06:37:07.640312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 486/961] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:07 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:08.654787 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:08.657395 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:08.664086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:08.664834 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:08.665275 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:08.665979 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:08.666432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:08.667048 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:08.790385 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:08.799883 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-10da53f8-bfcd-41dd-a7a6-8160dc86e04b tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1274 microversion: 2.1 time: 0.149125 Sep 09 06:37:08.800681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 476/962] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:08 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:09.823704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:09.824913 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:09.832321 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:09.832965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:09.833557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:09.834635 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:09.835258 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:09.835871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:09.840050 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=90 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:10.206865 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:10.216463 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4894be62-f0fc-4092-b3c8-4bc3423fe9c5 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.397008 Sep 09 06:37:10.217899 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 487/963] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:09 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:37:10.796194 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17de8ac9-0266-4f62-b890-24e43093c083", "tag": "f5e5320c-a0e5-4951-8361-359cf924a57c"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:10.808993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:10.809480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:10.810244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:10.824424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] Creating event network-changed:f5e5320c-a0e5-4951-8361-359cf924a57c for instance 17de8ac9-0266-4f62-b890-24e43093c083 on hv-cinder-85220 Sep 09 06:37:10.831920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-659de19d-69a3-4cd8-bd94-8a52bed8bb4d req-80e5a58d-3df4-4080-8185-238b0f23e0ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041189 Sep 09 06:37:10.833216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 477/964] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:11.240317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:11.241044 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:11.247632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:11.248276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:11.248780 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:11.249557 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:11.250268 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:11.250745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:11.411615 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:11.421124 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cd11a48a-702d-4359-95b4-39add43a42d2 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.183498 Sep 09 06:37:11.422025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 488/965] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:11 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:12.447854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:12.448825 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:12.461007 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:12.462108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:12.463065 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:12.464228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:12.464901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:12.465491 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:12.740078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:12.749528 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-27eca77e-cbd3-4ff2-b982-a3fc97e31653 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.308584 Sep 09 06:37:12.750685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 478/966] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:12 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:13.773629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:13.774526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:13.785459 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:13.786424 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:13.786870 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:13.787626 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:13.788085 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:13.788506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:14.002214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:14.012439 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-dc354103-4bab-45ee-9929-4259debb7134 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.243211 Sep 09 06:37:14.014598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 489/967] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:13 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:15.045372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:15.046070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:15.052909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:15.053605 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:15.054112 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:15.054814 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:15.057492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:15.057492 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:15.207828 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:15.215451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ce39ef78-c0e8-4229-b31d-815165d18265 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.174495 Sep 09 06:37:15.216092 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 479/968] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:15 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:16.244791 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:16.245994 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:16.249616 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17de8ac9-0266-4f62-b890-24e43093c083", "name": "network-vif-plugged", "status": "completed", "tag": "f5e5320c-a0e5-4951-8361-359cf924a57c"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:16.267585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:16.267585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:16.267585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:16.267585 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:16.267964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:16.267964 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:16.276927 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:16.277705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:16.278603 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:16.294490 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] Creating event network-vif-plugged:f5e5320c-a0e5-4951-8361-359cf924a57c for instance 17de8ac9-0266-4f62-b890-24e43093c083 on hv-cinder-85220 Sep 09 06:37:16.302265 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-db46c764-b248-4e18-b704-7700bad99130 req-2f982f7e-9d37-4119-adf9-9c8d18e6aab2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056377 Sep 09 06:37:16.303869 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 480/969] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:16.427507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:16.435305 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4ab68436-fdf0-46e1-95ac-2c49bd12bce6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.196063 Sep 09 06:37:16.436541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 490/970] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:16 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:17.459335 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:17.460081 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:17.465588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:17.467421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:17.468018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:17.468598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:17.469459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:17.469999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:17.470426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:17.490364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:17.625396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:17.633096 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ca2bf114-df07-4700-a29f-c1cf906f63c4 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.178406 Sep 09 06:37:17.633632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 481/971] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:17 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:18.659366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:18.660022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:18.662368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:18.667687 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:18.668182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:18.668629 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:18.669305 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:18.670331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:18.670832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:18.805517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:18.816300 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6a04e206-fd07-4026-8e44-f80c7cd70aeb tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.160701 Sep 09 06:37:18.816877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 491/972] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:18 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:19.847031 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:19.850397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:19.859404 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:19.860098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:19.861465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:19.865158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:19.866821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:19.867496 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:20.017846 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:20.027177 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-490dc209-5c4f-462d-82c7-8d1e344b7168 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1314 microversion: 2.1 time: 0.187335 Sep 09 06:37:20.028028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 482/973] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:19 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:21.058101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:21.058792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:21.065854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:21.066447 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:21.066883 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:21.067614 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:21.068276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:21.068700 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:21.213648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:21.226337 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-380d65f9-3e06-4117-849c-2f0ac38f3aab tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1496 microversion: 2.1 time: 0.172742 Sep 09 06:37:21.228374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 492/974] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:21 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1496 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:24.529754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:24.530429 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:24.537800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:24.538304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:24.538795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:24.539679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:24.540278 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:24.540764 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:24.571517 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:37:24.659141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3e1e5ad8-a1da-4d8c-aee0-b746940e44b0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 204 len: 0 microversion: 2.1 time: 0.133962 Sep 09 06:37:24.659810 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 483/975] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:37:24 2022] DELETE /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:37:24.669350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:24.670530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:24.678456 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:24.679167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:24.679801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:24.680730 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:24.681379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:24.681863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:24.847804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:24.860717 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2b7bd32d-2c49-4236-9f60-ce13abb52ead tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1502 microversion: 2.1 time: 0.195629 Sep 09 06:37:24.861951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 493/976] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:24 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1502 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:25.892285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:25.892993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:25.900385 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:25.900911 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:25.901350 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:25.902059 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:25.902541 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:25.903039 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:26.038508 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:26.047677 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-dc0b35b3-b564-405c-b032-51916aea4280 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1502 microversion: 2.1 time: 0.159713 Sep 09 06:37:26.048595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 484/977] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:25 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:26.634952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17de8ac9-0266-4f62-b890-24e43093c083", "name": "network-vif-deleted", "tag": "f5e5320c-a0e5-4951-8361-359cf924a57c"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:26.640774 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=24 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:26.646517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:26.646993 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:26.647418 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:26.659879 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] Creating event network-vif-deleted:f5e5320c-a0e5-4951-8361-359cf924a57c for instance 17de8ac9-0266-4f62-b890-24e43093c083 on hv-cinder-85220 Sep 09 06:37:26.664589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-deccc940-bc76-436e-ba86-7e67f68992a6 req-9404744b-ea2b-48b4-98fd-84596d7f57a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Sep 09 06:37:26.665176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 494/978] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:27.071392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:27.072012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:27.079269 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:27.079786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:27.080224 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:27.080913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:27.081374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:27.082043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:27.113128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:27.113610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:27.114043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:27.114481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lazy-loading 'fault' on Instance uuid 17de8ac9-0266-4f62-b890-24e43093c083 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:37:27.155498 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:27.163037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f6bb9f99-3386-4316-8b8f-947d07184649 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1304 microversion: 2.1 time: 0.095713 Sep 09 06:37:27.163615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 485/979] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:27 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:28.243721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:28.244423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:28.251181 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:28.251703 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:28.252142 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:28.252841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:28.253302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:28.253841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:28.284937 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:28.285411 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:28.285842 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:28.286279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lazy-loading 'fault' on Instance uuid 17de8ac9-0266-4f62-b890-24e43093c083 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:37:28.327243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:28.334844 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1e8ba8fe-f3e2-4b51-b273-2fda9b390a03 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1304 microversion: 2.1 time: 0.095814 Sep 09 06:37:28.335404 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 495/980] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:28 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:29.358860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:29.359461 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:29.362036 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:29.367448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:29.367961 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:29.368388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:29.369071 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:29.369525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:29.369949 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:29.402416 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:29.402889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:29.403313 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:29.404336 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lazy-loading 'fault' on Instance uuid 17de8ac9-0266-4f62-b890-24e43093c083 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:37:29.444163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:29.451818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-4cb3830c-fe0a-4a74-9540-9316a0024439 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 200 len: 1304 microversion: 2.1 time: 0.097327 Sep 09 06:37:29.452375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 486/981] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:29 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:30.474528 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:30.475092 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: 17de8ac9-0266-4f62-b890-24e43093c083] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:30.481573 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:30.482067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:30.482493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:30.483176 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:30.483675 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:30.484099 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:30.497106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] HTTP exception thrown: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Request method failure captured: Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 HTTP/1.1 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt8RWeLhTG1znHfj36zFzI1e72TBTps8rV-__JTo2KWP75a-dPl-zA-ra-K7Xw0wKJVn7_ga0PSexPs-H_ZDag32hzYHgIWygbLSV8vm-7B7qpcfbN7j-Ihcu9Cgv2fOVYI2h_pJWm_7anyM5pCMklJLoQ3BgfqxKI_FAjGr6G7oeVM Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: b5ecb76de8c443ba93d919ab2bad03c2 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:37:30.499346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: b5ecb76de8c443ba93d919ab2bad03c2 Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesActionsTest-1168561487-project Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: d8de3e1c91e343d6924f7f4ce08bf4e0 Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesActionsTest-1168561487-project Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. Sep 09 06:37:30.501058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': '17de8ac9-0266-4f62-b890-24e43093c083'} Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:37:30.502048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. Sep 09 06:37:30.503723 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:30.505140 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Returning 404 to user: Instance 17de8ac9-0266-4f62-b890-24e43093c083 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:37:30.505140 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e9939a56-6bea-4c57-93f1-48277f983635 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083" status: 404 len: 111 microversion: 2.1 time: 0.030622 Sep 09 06:37:30.505140 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 496/982] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:30 2022] GET /compute/v2.1/servers/17de8ac9-0266-4f62-b890-24e43093c083 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:37:30.605209 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2133616389", "imageRef": "af6f8299-2c8f-4703-b317-4b20997274a2", "flavorRef": "452", "networks": [{"uuid": "4db78c28-f49e-4229-95ad-8ceb42e8a419"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:30.673834 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] validate_networks() for [('4db78c28-f49e-4229-95ad-8ceb42e8a419', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:37:31.063678 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:37:31.064097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:37:31.064564 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:37:31.064966 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:37:31.065404 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:37:31.074054 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:31.074651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:31.075079 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:31.075858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:31.076813 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:31.077234 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:31.093186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Getting quotas for project b5ecb76de8c443ba93d919ab2bad03c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:37:31.097307 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Getting quotas for user d8de3e1c91e343d6924f7f4ce08bf4e0 and project b5ecb76de8c443ba93d919ab2bad03c2. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:37:31.107897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:37:31.110130 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='af6f8299-2c8f-4703-b317-4b20997274a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:37:31.156487 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-40e0a7b7-5356-4f4d-9fcc-31e979fbb3e1 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555342 Sep 09 06:37:31.157133 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 487/983] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:37:31.168421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-107f5c32-c90d-43ff-ae55-14775c9d1ec6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:31.169241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-107f5c32-c90d-43ff-ae55-14775c9d1ec6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:31.229630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-107f5c32-c90d-43ff-ae55-14775c9d1ec6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:31.236790 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-107f5c32-c90d-43ff-ae55-14775c9d1ec6 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1214 microversion: 2.1 time: 0.072365 Sep 09 06:37:31.237364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 497/984] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:31 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:32.260892 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:32.261674 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:32.268819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:32.269311 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:32.269770 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:32.270671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:32.271142 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:32.271692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:32.336954 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:32.344985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5959c88e-2683-4f06-8516-6957b7084370 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1274 microversion: 2.1 time: 0.088538 Sep 09 06:37:32.345551 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 488/985] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:32 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:33.368955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:33.369531 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:33.377306 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:33.377789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:33.378219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:33.378898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:33.379356 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:33.379804 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:33.440191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:33.447763 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9d45ee7b-e8ad-4d46-9fa2-dc1a4ed93646 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1274 microversion: 2.1 time: 0.082690 Sep 09 06:37:33.448320 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 498/986] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:33 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:34.470103 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:34.470710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:34.477397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:34.477882 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:34.478317 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:34.479010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:34.479469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:34.479922 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:34.541147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:34.549780 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-74276d7e-a1b1-4780-892f-edbe9c13e10d tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1274 microversion: 2.1 time: 0.083754 Sep 09 06:37:34.550355 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 489/987] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:34 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:35.573350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:35.574107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:35.581482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:35.581966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:35.582395 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:35.583079 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:35.583536 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:35.584036 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:35.835862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:35.844561 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-71282a05-554c-4f63-85c9-2a3f0d8ed2cf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.275183 Sep 09 06:37:35.845141 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 499/988] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:35 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:36.221562 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47cfe9e-1cb1-44d5-b236-73d8a8828c47", "tag": "090a3c19-4277-4b3a-a307-b946598e3cc3"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:36.250099 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:36.250993 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:36.252533 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:36.265422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] Creating event network-changed:090a3c19-4277-4b3a-a307-b946598e3cc3 for instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 on hv-cinder-85220 Sep 09 06:37:36.271375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-ff6eb1ea-9adf-48e7-9d53-b5d5c0c16904 req-4fc4f7aa-1a6f-4207-8294-46c353ff680b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054664 Sep 09 06:37:36.272607 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 490/989] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:36.870767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:36.871494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:36.878744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:36.879418 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:36.885326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:36.885326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:36.885326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:36.885326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:37.062888 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:37.070502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2ddfe198-fc5b-449e-ae29-bd5094d2511a tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.206978 Sep 09 06:37:37.071073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 500/990] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:36 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:38.095897 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:38.096881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:38.110650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:38.111173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:38.111651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:38.112378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:38.112852 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:38.113280 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:38.117613 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:38.256537 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:38.264835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6d978050-7084-400f-a734-a2ae16dd2174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.175588 Sep 09 06:37:38.265406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 491/991] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:38 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:39.288319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:39.288846 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:39.295868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:39.296350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:39.296846 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:39.297529 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:39.297984 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:39.298400 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:39.423777 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:39.431230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f9a6e300-0cff-4d67-9a45-ba585d884909 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.147071 Sep 09 06:37:39.431829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 501/992] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:39 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:40.454277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:40.454889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:40.461322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:40.461810 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:40.462245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:40.462932 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:40.463392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:40.463858 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:40.595345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:40.603134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-51fb276c-3934-48c8-ab3c-1143ef5a4dc3 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.152773 Sep 09 06:37:40.603734 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 492/993] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:40 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:41.628073 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:41.628773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:41.631803 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:41.639571 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:41.640203 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:41.640710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:41.641549 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:41.642091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:41.642567 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:41.646095 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=78 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:41.781260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:41.788854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5dd62c0d-5de6-4cba-bbe8-338bda06a184 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.165198 Sep 09 06:37:41.789452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 502/994] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:41 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:42.788228 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cfe9e-1cb1-44d5-b236-73d8a8828c47", "name": "network-vif-plugged", "status": "completed", "tag": "090a3c19-4277-4b3a-a307-b946598e3cc3"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:42.793153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:42.793821 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=6 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:37:42.800890 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:42.801327 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:42.801759 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:42.816411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] Creating event network-vif-plugged:090a3c19-4277-4b3a-a307-b946598e3cc3 for instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 on hv-cinder-85220 Sep 09 06:37:42.817619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:42.818677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:42.821170 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-0ede8ef1-e3aa-477b-ae96-ce2700281eb8 req-03df7aac-c6c2-4cc4-a75e-531f17637436 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036617 Sep 09 06:37:42.821836 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 493/995] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:42.828598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:42.829096 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:42.829526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:42.830223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:42.830849 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:42.831276 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:42.973481 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:42.981323 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-4a32a674-3989-4a23-bedd-35b0147e3446 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.172963 Sep 09 06:37:42.982389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 503/996] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:42 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:37:44.006095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:44.007422 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:44.015520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:44.016448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:44.017196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:44.018227 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:44.018692 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:44.019118 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:44.150413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:44.162301 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-78378052-7845-4332-9a11-cfe2de1534bf tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1314 microversion: 2.1 time: 0.160604 Sep 09 06:37:44.163056 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 494/997] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:43 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:45.186775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:45.187389 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:45.193781 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.194291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.194745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:45.195473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.195966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.196409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:45.329099 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:45.336773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d008ddbb-3b04-484f-8b53-7a6523bd6174 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1496 microversion: 2.1 time: 0.154708 Sep 09 06:37:45.337329 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 504/998] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:45 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:45.847881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:45.848416 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:45.854703 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.855187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.855736 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:45.856939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.857595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.858242 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:45.883197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Going to try to terminate instance {{(pid=120797) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:37:45.969536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9d3655d2-cf1f-44e2-a2f8-21bdf5f0dd61 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 204 len: 0 microversion: 2.1 time: 0.125332 Sep 09 06:37:45.970369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 495/999] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:37:45 2022] DELETE /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:37:45.979107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:45.979868 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:45.986641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.987204 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.987743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:45.988506 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:45.989043 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:45.989553 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:46.133023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:46.141877 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d4800798-a206-4f02-8160-6a8417fbcef0 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1502 microversion: 2.1 time: 0.166915 Sep 09 06:37:46.142455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 505/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:45 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:47.166312 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:47.167158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:47.173159 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:47.173650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:47.174087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:47.174785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:47.175248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:47.175708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:47.318185 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:47.326838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2d684e28-b32d-41c4-b06e-c35b15e2dd16 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1502 microversion: 2.1 time: 0.164833 Sep 09 06:37:47.327274 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 496/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:47 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:48.105926 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47cfe9e-1cb1-44d5-b236-73d8a8828c47", "name": "network-vif-deleted", "tag": "090a3c19-4277-4b3a-a307-b946598e3cc3"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:37:48.119851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:48.120340 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:48.121069 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:48.136294 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] Creating event network-vif-deleted:090a3c19-4277-4b3a-a307-b946598e3cc3 for instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 on hv-cinder-85220 Sep 09 06:37:48.143093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-8a49604f-93da-45d3-a9a5-9379dae3bf48 req-35d3e505-5920-419c-ae4d-845ebf8a8930 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041346 Sep 09 06:37:48.144094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 506/1002] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:37:48.351304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:48.352041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:48.358292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:48.358778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:48.359215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:48.359943 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:48.360398 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:48.360820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:48.394671 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:48.395158 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:48.395620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:48.396063 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lazy-loading 'fault' on Instance uuid f47cfe9e-1cb1-44d5-b236-73d8a8828c47 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:37:48.438345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8de3e1c91e343d6924f7f4ce08bf4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ecb76de8c443ba93d919ab2bad03c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:37:48.447448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2f8050bb-42f0-4f9b-834e-c28bbcf5b706 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 200 len: 1304 microversion: 2.1 time: 0.099811 Sep 09 06:37:48.459668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 497/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:48 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:37:49.471913 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:37:49.472881 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] [instance: f47cfe9e-1cb1-44d5-b236-73d8a8828c47] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:37:49.481211 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:49.482588 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:49.483071 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:49.483813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:37:49.484262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:37:49.484840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:37:49.500240 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] HTTP exception thrown: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Request method failure captured: Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 HTTP/1.1 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt8RWeLhTG1znHfj36zFzI1e72TBTps8rV-__JTo2KWP75a-dPl-zA-ra-K7Xw0wKJVn7_ga0PSexPs-H_ZDag32hzYHgIWygbLSV8vm-7B7qpcfbN7j-Ihcu9Cgv2fOVYI2h_pJWm_7anyM5pCMklJLoQ3BgfqxKI_FAjGr6G7oeVM Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: b5ecb76de8c443ba93d919ab2bad03c2 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:37:49.501885 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b5ecb76de8c443ba93d919ab2bad03c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: b5ecb76de8c443ba93d919ab2bad03c2 Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-VolumesActionsTest-1168561487 Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-VolumesActionsTest-1168561487-project Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: d8de3e1c91e343d6924f7f4ce08bf4e0 Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-VolumesActionsTest-1168561487-project Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. Sep 09 06:37:49.503582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'f47cfe9e-1cb1-44d5-b236-73d8a8828c47'} Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:37:49.504518 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. Sep 09 06:37:49.506093 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:37:49.507478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] Returning 404 to user: Instance f47cfe9e-1cb1-44d5-b236-73d8a8828c47 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:37:49.507478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5e719e29-85a0-4bf5-82bd-6dfd78501561 tempest-VolumesActionsTest-1168561487 tempest-VolumesActionsTest-1168561487-project] 10.222.0.25 "GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47" status: 404 len: 111 microversion: 2.1 time: 0.035870 Sep 09 06:37:49.507478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 507/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:37:49 2022] GET /compute/v2.1/servers/f47cfe9e-1cb1-44d5-b236-73d8a8828c47 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 06:38:22.449486 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:22.452216 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:22.922726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2627cb37-319e-4ece-876f-cf444573a07b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Action: 'create', calling method: .version_select at 0x7f74aceeeb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-366509566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+d3XWYwtr1FL5RvpMQ17xSKeK//Bexleya/vdAtDr5w5pKrWtJvu7/3vqMb6qTCwNshTFxeOR3dTYiwHDO21U8HDCvDlnDUvISCzzs88yuleCULQ6uVg75fXPqDh/Hkg=="}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:22.973814 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-2627cb37-319e-4ece-876f-cf444573a07b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Getting quotas for project 240d1fbee4bc4dbeb359f463302be8ee. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:38:22.987987 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-2627cb37-319e-4ece-876f-cf444573a07b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Getting quotas for user b84d34323691437b9e2e9e99c29db0f1 and project 240d1fbee4bc4dbeb359f463302be8ee. Resources: {'key_pairs'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:38:23.040409 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2627cb37-319e-4ece-876f-cf444573a07b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.600566 Sep 09 06:38:23.045898 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 498/1005] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:38:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:26.275911 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-89562f39-b59b-4a87-bc02-9752e94a93bd tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'create', calling method: .version_select at 0x7f74ad09e5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-241080136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsEXKO2IDU98yOzwtCSYi5H3AHJlPnIQ7jWYiuZEIa2okOv7PzQdBH9koyy9ywWD5JToAo6g+4183XN2f7NvrjSdecPDKIc6K6IsdIlS2OYo+lcF9iBCdakdcaDd90SGQ=="}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:26.282512 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=31 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:26.283168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=27 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:26.296032 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-89562f39-b59b-4a87-bc02-9752e94a93bd tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Getting quotas for project 3312523776514be3a56e169c9234168b. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:38:26.300015 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-89562f39-b59b-4a87-bc02-9752e94a93bd tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Getting quotas for user baef9538b75b4244b6ccf0922af7e5b1 and project 3312523776514be3a56e169c9234168b. Resources: {'key_pairs'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:38:26.323648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-89562f39-b59b-4a87-bc02-9752e94a93bd tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051491 Sep 09 06:38:26.324233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 508/1006] 10.222.0.25 () {60 vars in 1159 bytes} [Fri Sep 9 06:38:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:26.427378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1751744117", "imageRef": "fef3f1e7-48d7-4e6a-9361-415e81d8f874", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-241080136", "networks": [{"uuid": "dd5e95ac-8469-4af2-8573-83017cfeb570"}]}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:26.484060 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.network.neutron [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] validate_networks() for [('dd5e95ac-8469-4af2-8573-83017cfeb570', None, None, None, None, None)] {{(pid=120797) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:38:26.897760 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Flavor limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:38:26.898428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Image limits 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:38:26.899225 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Flavor pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:38:26.899983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Image pref 0:0:0 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:38:26.900803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.virt.hardware [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120797) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:38:26.912374 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:26.913540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:26.914633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:26.916019 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:26.916730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:26.918108 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:26.938460 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Getting quotas for project 3312523776514be3a56e169c9234168b. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:38:26.942738 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.quota [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Getting quotas for user baef9538b75b4244b6ccf0922af7e5b1 and project 3312523776514be3a56e169c9234168b. Resources: {'cores', 'ram', 'instances'} {{(pid=120797) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:38:26.960632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Going to run 1 instances... {{(pid=120797) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:38:26.962901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fef3f1e7-48d7-4e6a-9361-415e81d8f874',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120797) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:38:27.024573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f8203c96-1fab-4995-a942-ab0e20abac42 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601702 Sep 09 06:38:27.031738 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 499/1007] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:38:27.037028 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a2a83088-2517-49ea-bc7c-0ae5f1620a71 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:27.038004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a2a83088-2517-49ea-bc7c-0ae5f1620a71 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:27.111038 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a2a83088-2517-49ea-bc7c-0ae5f1620a71 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:27.118063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a2a83088-2517-49ea-bc7c-0ae5f1620a71 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1258 microversion: 2.1 time: 0.085020 Sep 09 06:38:27.118648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 509/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:27 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:28.144328 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:28.145120 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:28.153116 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:28.153609 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:28.154041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:28.154744 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:28.155202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:28.155652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:28.230476 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:28.239753 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b8b44691-8b4c-49b6-901a-75f21b9f0051 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1310 microversion: 2.1 time: 0.099190 Sep 09 06:38:28.240615 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 500/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:28 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:29.273843 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:29.279387 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:29.293534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:29.297060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:29.297744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:29.298688 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:29.302183 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:29.302884 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:30.204275 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:30.235582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7eb862cb-398a-4e35-a37a-a06b6255bdd0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.969763 Sep 09 06:38:30.243925 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 510/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:29 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:31.267903 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:31.269239 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:31.283857 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:31.300413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:31.301190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:31.302184 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:31.305191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:31.305896 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:31.411792 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:31.431747 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:31.432249 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:31.432712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:31.484710 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] Creating event network-changed:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:38:31.503473 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-1d0dfb7a-9f6e-4e04-b5b3-6c4ccc083cf9 req-bac624b8-4651-459b-a8fd-083b0a9e3cb3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101064 Sep 09 06:38:31.518708 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 511/1011] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:31.932536 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:31.941881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-97f4e753-54a0-426c-8399-b6b2374757f5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.678284 Sep 09 06:38:31.943135 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 501/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:31 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:32.968866 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:32.970619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:32.978491 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:32.979322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:32.980133 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:32.981068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:32.982002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:32.982636 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:33.147919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:33.156796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cb723016-e55b-4e89-83c6-213db8c7bf08 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.193951 Sep 09 06:38:33.157383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 512/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:32 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:34.180703 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:34.181341 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:34.188920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:34.189456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:34.189926 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:34.190679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:34.191173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:34.191637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:34.358620 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:34.366946 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0d121849-7c4a-4953-83f4-6d6f3d339279 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.190475 Sep 09 06:38:34.368081 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 502/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:34 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:35.397894 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:35.398665 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:35.407355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:35.408055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:35.408737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:35.409446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:35.409904 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:35.410325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:35.554014 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:35.563083 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-76b1d6e8-4e88-4f2e-baae-bd0ae38d56f3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.170248 Sep 09 06:38:35.563693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 513/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:35 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:36.587421 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:36.588330 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:36.603206 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:36.603752 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:36.604195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:36.605101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:36.605667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:36.606086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:36.753041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:36.765323 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-fd6f775c-3647-403a-87e2-45a340b43d7d tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.182760 Sep 09 06:38:36.775935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 503/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:36 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:37.790582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:37.791229 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:37.793865 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=6 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:37.798921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:37.799409 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:37.799871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:37.800552 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:37.801006 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:37.801423 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:37.970550 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:37.978487 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3c6beb32-1313-4978-8b2b-388692c74b05 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.191793 Sep 09 06:38:37.979044 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 514/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:37 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:39.001650 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:39.002205 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:39.003982 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:39.004669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=10 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:39.011097 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:39.011737 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:39.012175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:39.012856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:39.013309 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:39.013729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:39.142988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:39.150668 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5a37e5c7-2b6b-4b22-b3a2-2664c5d4fa97 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.152900 Sep 09 06:38:39.151975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 504/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:38 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:40.172931 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:40.173536 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:40.179840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:40.180323 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:40.180753 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:40.181434 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:40.181886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:40.182306 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:40.316054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:40.324322 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-f08ac8ef-d1a3-4d6f-9aa9-78a7013a2ad4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.155245 Sep 09 06:38:40.324882 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 515/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:40 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:41.347832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:41.348468 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:41.355086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:41.355933 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:41.356372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:41.357062 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:41.357518 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:41.357937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:41.530740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:41.539470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5af6792c-59cd-4946-b454-91e8592f1137 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.195637 Sep 09 06:38:41.540371 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 505/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:41 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:42.334374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1781933208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-366509566", "security_groups": [{"name": "tempest-secgroup-smoke-1642969613"}], "networks": [{"uuid": "0156bdc7-bb9c-40f9-8ffd-76befb64af9f"}], "block_device_mapping_v2": [{"uuid": "2ea46e15-f75f-450d-819d-c888228ecd3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:42.446481 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.network.neutron [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] validate_networks() for [('0156bdc7-bb9c-40f9-8ffd-76befb64af9f', None, None, None, None, None)] {{(pid=120795) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 06:38:42.562701 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:42.563310 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:42.573466 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:42.573989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:42.574413 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:42.575106 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:42.575587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:42.576070 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:42.774414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:42.781947 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-e7541eb7-ccea-4a95-8f08-c47aec2c9f49 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.223603 Sep 09 06:38:42.782521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 506/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:42 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:38:42.888324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Flavor limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 06:38:42.888749 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Image limits 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 06:38:42.889243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Flavor pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 06:38:42.890001 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Image pref 0:0:0 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 06:38:42.890419 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.virt.hardware [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 06:38:42.899214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:42.899742 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:42.900182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:42.900914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:42.901406 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:42.902393 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:42.920886 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Getting quotas for project 240d1fbee4bc4dbeb359f463302be8ee. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 06:38:42.924862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.quota [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Getting quotas for user b84d34323691437b9e2e9e99c29db0f1 and project 240d1fbee4bc4dbeb359f463302be8ee. Resources: {'cores', 'ram', 'instances'} {{(pid=120795) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 06:38:42.982107 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Going to run 1 instances... {{(pid=120795) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 06:38:42.984288 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea46e15-f75f-450d-819d-c888228ecd3f',volume_size=None,volume_type=None)] {{(pid=120795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 06:38:43.121654 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8943f02a-f23e-428d-bb02-06ae5385398e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790975 Sep 09 06:38:43.128457 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 516/1022] 10.222.0.25 () {60 vars in 1147 bytes} [Fri Sep 9 06:38:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 06:38:43.133397 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0ce5b788-f035-4939-8741-3dbd83a5405e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:43.134077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0ce5b788-f035-4939-8741-3dbd83a5405e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:43.184154 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "name": "network-vif-plugged", "status": "completed", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:43.199820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0ce5b788-f035-4939-8741-3dbd83a5405e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:43.200205 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:43.207073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0ce5b788-f035-4939-8741-3dbd83a5405e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1088 microversion: 2.1 time: 0.077404 Sep 09 06:38:43.207667 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 507/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:43 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:43.207874 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:43.208468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:43.220233 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] Creating event network-vif-plugged:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:38:43.226155 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-20f62ea2-9f0b-4ed6-a533-f1fbc13b9dea req-759259b3-3436-41d6-a38d-6d5046e8d708 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047162 Sep 09 06:38:43.226858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 517/1024] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:43.804913 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:43.805512 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:43.813681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:43.814171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:43.814600 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:43.815296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:43.815782 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:43.816207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:43.943877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:43.952208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7ac4850a-32a4-40f3-a950-85971f63f031 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1358 microversion: 2.1 time: 0.151073 Sep 09 06:38:43.952778 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 508/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:43 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:44.232070 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:44.232871 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:44.238972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:44.239458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:44.239966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:44.240659 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:44.241114 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:44.241542 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:44.305544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:44.314347 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5139baa8-d9c7-41de-9d60-012e0b6f593a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1186 microversion: 2.1 time: 0.087564 Sep 09 06:38:44.314910 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 518/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:44 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:44.974579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:44.975256 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:44.981889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:44.982379 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:44.982820 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:44.983514 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:44.984003 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:44.984438 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.113549 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:45.121196 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-2b2a1aed-f9b4-42a9-9ead-e3970e3c4064 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1548 microversion: 2.1 time: 0.150827 Sep 09 06:38:45.122279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 509/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:44 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:45.144972 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:45.145326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:45.151692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.152184 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.152697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.153642 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.154113 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.154540 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.338028 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:45.338860 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:45.345424 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.345921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.346633 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.347326 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.347839 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.348268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.367741 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:45.378486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-2b8b9439-956f-4011-bb18-099906a21b9b tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1548 microversion: 2.1 time: 0.237609 Sep 09 06:38:45.380025 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 519/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:45 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:45.404343 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:45.409951 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:45.410800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Searching by: {'deleted': False, 'project_id': '3312523776514be3a56e169c9234168b'} {{(pid=120795) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 06:38:45.417627 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.418188 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.418408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:45.419417 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.420264 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.420799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.421478 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.426375 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-087c1ac6-93d5-4623-a362-594b531d5d76 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1204 microversion: 2.1 time: 0.092572 Sep 09 06:38:45.426956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 510/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:45 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:38:45.517382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.multi_cell_list [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120795) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 06:38:45.614383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-640fd343-3a92-4c19-ae6f-36b3bbfa23ba tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214500 Sep 09 06:38:45.614900 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 520/1030] 10.222.0.25 () {58 vars in 1125 bytes} [Fri Sep 9 06:38:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:38:45.629143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:45.629772 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:45.636023 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.636505 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.636941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.637648 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:45.638115 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:45.638534 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:45.849009 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:45.857803 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-799fa630-170a-45b2-a6db-cee12ee3dd11 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1548 microversion: 2.1 time: 0.233054 Sep 09 06:38:45.858388 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 511/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:45 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:46.451586 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:46.452304 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:46.458801 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:46.459366 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:46.459830 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:46.460580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:46.461059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:46.461472 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:46.704350 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:46.714054 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3224d0cc-1ad2-4fd2-bf33-9e9a0207d3a4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.267286 Sep 09 06:38:46.714805 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 521/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:46 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:46.851856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:46.862950 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:46.863431 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:46.864082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:46.876325 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] Creating event network-changed:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:38:46.881423 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-96155b03-fc58-4534-9904-01405428e8b0 req-57823830-b243-464b-8542-21d25a4ba5f5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Sep 09 06:38:46.882024 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 512/1033] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:47.457667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d3ff22-5b5f-4158-a008-e612a002dd63"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:47.460067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:47.467193 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:47.467716 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:47.468160 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:47.468862 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:47.469326 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:47.469748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:47.714193 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e41c9ae1-5f26-4457-96d2-995fcf4d3278 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260251 Sep 09 06:38:47.714858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 522/1034] 10.222.0.25 () {60 vars in 1323 bytes} [Fri Sep 9 06:38:47 2022] POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:47.738816 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:47.739796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:47.746975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:47.747805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:47.748245 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:47.748945 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:47.749846 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:47.750455 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:48.000077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:48.007758 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ed25aa8e-cb78-4cdb-9e74-6d6c4eac5c75 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.273364 Sep 09 06:38:48.008268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 513/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:47 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:49.032854 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:49.033577 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:49.039793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:49.040284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:49.040721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:49.041410 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:49.041873 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:49.042298 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:49.177917 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:49.185551 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1f977848-a1f1-48b2-b1b3-5df840e866c4 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.157984 Sep 09 06:38:49.186122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 523/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:49 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:50.208073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:50.208708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:50.215239 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:50.215910 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:50.216348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:50.217043 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:50.217503 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:50.217927 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:50.347909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:50.356393 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1a7566af-b423-4f4b-b312-78f0b58562ab tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.151578 Sep 09 06:38:50.356964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 514/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:50 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:51.378428 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:51.378978 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:51.385373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:51.385859 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:51.386290 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:51.387630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:51.388100 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:51.388526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:51.522822 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:51.531281 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-01761d02-cdf1-4f20-9d85-05896a70c86b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.156810 Sep 09 06:38:51.531880 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 524/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:51 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:52.553647 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:52.554264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:52.556726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:52.563052 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:52.563560 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:52.564021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:52.564726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:52.565192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:52.565618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:52.569054 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=83 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:52.863501 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:52.871334 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1c67b5dc-57af-42d6-a174-47eabe1b6d6a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.321461 Sep 09 06:38:52.872520 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 515/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:52 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:53.895380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:53.895942 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:53.898331 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=6 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:53.904057 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:53.904551 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:53.905022 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:53.905740 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:53.906196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:53.906619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:54.035378 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:54.043469 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0d89faae-85e3-4bf4-8625-d57904d3f34e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.151515 Sep 09 06:38:54.044078 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 525/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:53 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:55.067415 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:55.068214 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:55.071354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell0:SELECT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:55.078462 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:55.078956 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:55.079392 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:55.080204 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:55.080664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:55.081087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:55.214110 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:55.222651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-50413b01-b3c4-4be2-831e-4fa2c9ad89db tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.160144 Sep 09 06:38:55.223331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 516/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:55 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:55.387625 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:55.388272 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:55.394569 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:55.395052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:55.395483 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:55.396194 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:55.396680 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:55.397109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:55.456631 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell0:SELECT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:55.526231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:55.529667 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:55.535289 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7afd66be-c1cd-4405-a39f-dfc22c3a4a44 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1594 microversion: 2.1 time: 0.151640 Sep 09 06:38:55.535913 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 526/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:55 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:56.245411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:56.246045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:56.252428 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:56.252915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:56.253347 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:56.254037 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:56.254493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:56.254923 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:56.389617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:56.397290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1e0fde6d-130f-40bc-8c04-52a042d9cfbc tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.155679 Sep 09 06:38:56.397850 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 517/1043] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:56 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:38:57.401057 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "name": "network-vif-plugged", "status": "completed", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:57.422482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:57.423742 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:57.445406 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:57.446444 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:57.446900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:57.450545 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:57.452190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:57.454292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:57.455081 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:38:57.467443 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:57.468386 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:57.469136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:57.492139 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] Creating event network-vif-plugged:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:38:57.498806 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-1f40e1d6-d37d-4d37-9fa5-76e25b3ded6f req-467fefc8-4e41-4d3c-9b52-9f90261bfda3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104756 Sep 09 06:38:57.499522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 527/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:57.603921 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:57.643371 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:57.644068 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:57.644538 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:57.660892 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] Creating event network-changed:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:38:57.680584 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-e6105bbf-632e-4057-af47-5fe971772c35 req-e0eadff8-e7db-46d9-9e59-60b54b5f8475 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083895 Sep 09 06:38:57.683274 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 528/1045] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:38:57.711681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:57.720632 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3c6499eb-14cf-477c-86e4-026238266d4e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.302765 Sep 09 06:38:57.736082 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 518/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:57 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:38:58.572877 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e820aa70-b6d5-402e-8756-7cf97e6a4470", "tag": "573ec978-54c6-4cc6-bf36-204feb7eff85"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:58.576773 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:58.577505 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:58.599715 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.600214 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.603104 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.603935 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.607416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.607996 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.608411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.609366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.610027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.635976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] Creating event network-changed:573ec978-54c6-4cc6-bf36-204feb7eff85 for instance e820aa70-b6d5-402e-8756-7cf97e6a4470 on hv-cinder-85220 Sep 09 06:38:58.643414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-08e2d85a-96e6-4f56-bff3-90dc3a6218a0 req-6674e739-4c53-4321-aca0-a8cad35d24bc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074101 Sep 09 06:38:58.645478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 519/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:38:58.645872 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:38:58.662797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-265886013"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:38:58.664463 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:58.672927 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.673529 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.674039 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.674870 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.675403 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.677221 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.752895 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ce2bd90b-5bb2-4303-aa9a-b0ba423970ca tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 204 len: 0 microversion: 2.1 time: 0.186400 Sep 09 06:38:58.771071 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 529/1048] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:38:58 2022] DELETE /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:38:58.786583 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:58.788788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:58.796260 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.797007 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.797601 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.798616 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:58.799263 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:58.800265 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:58.957887 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.network.security_group_api [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Adding security group 4a3c9396-e843-4d0d-8a3b-fd9d9269ae1c to port 5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 Sep 09 06:38:59.046172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:59.054048 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3bf7b056-c1da-45b6-9ef3-d02fde22de35 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.280398 Sep 09 06:38:59.054647 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 530/1049] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:58 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:59.059919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:59.060514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:59.068996 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:59.070049 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:59.070706 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:59.071784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:59.072734 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:59.073422 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:59.284238 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:59.293328 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-69a555c9-c86b-48c0-aced-6958fcc3dedc tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1578 microversion: 2.1 time: 0.237257 Sep 09 06:38:59.307335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 531/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:59 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1578 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:38:59.399693 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-46fddeb4-654b-4830-adc9-2ca7b7e58b46 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.743089 Sep 09 06:38:59.400304 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 520/1051] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:38:58 2022] POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:38:59.408733 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:38:59.409346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:38:59.415503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:59.416058 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:59.416494 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:59.417191 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:38:59.417649 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:38:59.418074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:38:59.588630 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:38:59.601352 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e7bfd644-ea36-4aab-923b-a3a5391a7e2a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1640 microversion: 2.1 time: 0.196240 Sep 09 06:38:59.601962 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 532/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:38:59 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1640 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:00.080646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:00.086935 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:00.094182 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:00.094676 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:00.095114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:00.107244 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:00.108662 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:00.109561 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:00.317128 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:00.318305 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:00.325087 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:00.325914 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:00.326436 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:00.327190 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:00.327750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:00.328170 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:00.376937 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:00.384511 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-9de9f99e-4c28-4194-aed3-52940a6595b9 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1260 microversion: 2.1 time: 0.310897 Sep 09 06:39:00.385114 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 521/1053] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:00 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1260 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:00.466754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:00.474813 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-48026920-175a-488f-b643-47549b8b2976 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1578 microversion: 2.1 time: 0.161532 Sep 09 06:39:00.475396 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 533/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:00 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:39:00.676769 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:00.686889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:00.687372 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:00.687832 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:00.700900 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] Creating event network-changed:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:39:00.706217 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-7a285de6-16b7-41ed-bee9-dba3016b373f req-c50e1cc4-8ec1-46da-a237-0efe4157d7dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033180 Sep 09 06:39:00.706808 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 522/1055] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:39:01.409918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:01.410725 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:01.419291 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:01.420106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:01.420664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:01.421469 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:01.422027 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:01.422645 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:01.500297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:01.501128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:01.507612 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:01.508202 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:01.508708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:01.509502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:01.510033 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:01.510524 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:02.063595 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:02.073624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-90fa3b72-bd97-447c-99db-cad4fe2bd9fe tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1459 microversion: 2.1 time: 0.578302 Sep 09 06:39:02.074747 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 523/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:01 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1459 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:39:02.088221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:02.097579 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6397dc6d-8bd1-41cb-8e9e-3ae2caa1645f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1444 microversion: 2.1 time: 0.692285 Sep 09 06:39:02.098250 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 534/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:01 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1444 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:02.119725 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:02.120331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:02.126178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:02.126656 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:02.127084 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:02.127796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:02.128253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:02.128669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:02.381575 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:02.389964 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-970828de-c91c-4651-b48b-275ffe091143 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1444 microversion: 2.1 time: 0.274260 Sep 09 06:39:02.390637 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 524/1058] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:02 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1444 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:02.736918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e820aa70-b6d5-402e-8756-7cf97e6a4470", "name": "network-vif-deleted", "tag": "573ec978-54c6-4cc6-bf36-204feb7eff85"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:02.748040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:02.748534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:02.748965 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:02.760373 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] Creating event network-vif-deleted:573ec978-54c6-4cc6-bf36-204feb7eff85 for instance e820aa70-b6d5-402e-8756-7cf97e6a4470 on hv-cinder-85220 Sep 09 06:39:02.766975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-a19637fe-c142-467c-ac1b-15c27e4b8a10 req-1627dfcb-26bc-4426-88fe-819901c91a5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Sep 09 06:39:02.768149 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 535/1059] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:39:03.098479 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:03.099365 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:03.106087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:03.106700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:03.107233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:03.108175 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:03.108827 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:03.109285 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:03.147686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:03.148186 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:03.148626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:03.149074 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lazy-loading 'fault' on Instance uuid e820aa70-b6d5-402e-8756-7cf97e6a4470 {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:39:03.217618 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:03.225267 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-dc478863-d760-427d-b36d-9933c53e17ed tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 200 len: 1185 microversion: 2.1 time: 0.130917 Sep 09 06:39:03.226095 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 525/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:03 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 1185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:04.252380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:04.253094 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: e820aa70-b6d5-402e-8756-7cf97e6a4470] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:04.260975 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:04.262039 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:04.262467 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:04.264283 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:04.264750 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:04.265174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:04.281064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] HTTP exception thrown: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Request method failure captured: Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 HTTP/1.1 Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt2IOwqgpRP4wCTOGHjzuatqxiUXtq3ZLBZCMsBm0jWW1xejAfkoR1kJnUOdzMgEiiLZ6JoHah8D8jnKXlpPoCFy1l8pKsupTtr_uyAgRsBBzFtUQNjKXAxFyeLfK3mODX61vCBAQowI0wQkYMvw7rvlX6cL4gXReSbMDteGICR_Kxo Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:39:04.283167 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 472b6623f57a41568fe7ffce8e40e350 Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. Sep 09 06:39:04.284919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'e820aa70-b6d5-402e-8756-7cf97e6a4470'} Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:39:04.285745 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. Sep 09 06:39:04.287353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:04.290368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Returning 404 to user: Instance e820aa70-b6d5-402e-8756-7cf97e6a4470 could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:39:04.290368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-1e1ffc1d-6e76-4198-9ac2-042991246d01 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470" status: 404 len: 111 microversion: 2.1 time: 0.037844 Sep 09 06:39:04.290368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 536/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:04 2022] GET /compute/v2.1/servers/e820aa70-b6d5-402e-8756-7cf97e6a4470 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:39:04.788646 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:04.798909 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:04.800358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:04.800358 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:04.813918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] Creating event network-changed:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:39:04.820279 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-c8eb4841-8184-4ec9-8c73-a54f3e1086d1 req-71a6f16d-c63d-4a2f-a48d-1bb09832865a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035291 Sep 09 06:39:04.820939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 526/1062] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:39:07.383690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:07.384262 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:07.387410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de17e99-45f8-4fdc-8e35-f0f38d6737f8", "tag": "3690fe7c-0bd9-4039-a5dd-e333a1aaefe2"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:07.391421 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:07.391987 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:07.392416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:07.393220 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:07.393672 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:07.394091 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:07.398001 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:07.398617 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:07.399153 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:07.411728 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] Creating event network-changed:3690fe7c-0bd9-4039-a5dd-e333a1aaefe2 for instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 on hv-cinder-85220 Sep 09 06:39:07.418021 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-0d4b7e28-609f-4fe2-b009-11dba34d07f8 req-88c700f3-2522-4c8c-87e2-1bb22c7519e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035674 Sep 09 06:39:07.419073 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 527/1063] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:39:07.427248 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:39:07.518775 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-43d8736a-a082-4d59-a5fe-653ce7593acb tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 204 len: 0 microversion: 2.1 time: 0.139187 Sep 09 06:39:07.519380 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 537/1064] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:39:07 2022] DELETE /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:39:07.533711 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:07.534862 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:07.542130 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:07.543195 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:07.543960 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:07.544991 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:07.545681 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:07.546348 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:07.707853 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:07.715902 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7ac892cf-26a3-4800-bdb6-bb5edb924df3 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1578 microversion: 2.1 time: 0.186748 Sep 09 06:39:07.716598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 528/1065] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:07 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:08.740982 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:08.741676 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:08.748646 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:08.749130 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:08.749555 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:08.750241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:08.750690 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:08.751106 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:08.913052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:08.922000 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-9fc89993-d475-4368-b5f9-27112e32614d tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1578 microversion: 2.1 time: 0.185128 Sep 09 06:39:08.922841 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 538/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:08 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:09.946761 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:09.947383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:09.954553 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:09.955049 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:09.955995 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:09.956706 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:09.957171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:09.957598 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:10.075223 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de17e99-45f8-4fdc-8e35-f0f38d6737f8", "name": "network-vif-deleted", "tag": "3690fe7c-0bd9-4039-a5dd-e333a1aaefe2"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:10.077146 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472b6623f57a41568fe7ffce8e40e350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09397aeb58f44f7c9f0ab921e471079a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:10.088187 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:10.088731 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:10.089086 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0177b409-68c0-462d-a3da-f17360ec7a68 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 200 len: 1392 microversion: 2.1 time: 0.147124 Sep 09 06:39:10.089235 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:10.107626 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 529/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:09 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:10.118234 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] Creating event network-vif-deleted:3690fe7c-0bd9-4039-a5dd-e333a1aaefe2 for instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 on hv-cinder-85220 Sep 09 06:39:10.123918 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-3c791653-d5d1-43e7-a18d-3c3f031e45d3 req-364c5311-1664-4e6c-8827-e491772eeb4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054647 Sep 09 06:39:10.124848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 539/1068] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:39:11.114363 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:11.114990 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: 0de17e99-45f8-4fdc-8e35-f0f38d6737f8] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:11.121624 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.122117 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.122552 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.123246 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.123739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.124171 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.139481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] HTTP exception thrown: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Request method failure captured: Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 HTTP/1.1 Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt2IOwqgpRP4wCTOGHjzuatqxiUXtq3ZLBZCMsBm0jWW1xejAfkoR1kJnUOdzMgEiiLZ6JoHah8D8jnKXlpPoCFy1l8pKsupTtr_uyAgRsBBzFtUQNjKXAxFyeLfK3mODX61vCBAQowI0wQkYMvw7rvlX6cL4gXReSbMDteGICR_Kxo Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:39:11.141134 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 472b6623f57a41568fe7ffce8e40e350 Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. Sep 09 06:39:11.142924 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': '0de17e99-45f8-4fdc-8e35-f0f38d6737f8'} Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:39:11.144075 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. Sep 09 06:39:11.145792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.147396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Returning 404 to user: Instance 0de17e99-45f8-4fdc-8e35-f0f38d6737f8 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:39:11.147396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-566572ee-747e-4ff1-8423-0635fc3e295f tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8" status: 404 len: 111 microversion: 2.1 time: 0.032178 Sep 09 06:39:11.147396 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 530/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:11 2022] GET /compute/v2.1/servers/0de17e99-45f8-4fdc-8e35-f0f38d6737f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:39:11.609302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:11.609898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:11.616247 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.616736 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.617173 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.617855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.618312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.618732 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.632222 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.wsgi [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] HTTP exception thrown: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Request method failure captured: Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: request: DELETE /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb HTTP/1.1 Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept: application/json Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Accept-Encoding: identity Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Connection: close Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Length: 0 Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Content-Type: application/json Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Host: 10.222.0.25 Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Openstack-System-Scope: None Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: User-Agent: python-urllib3/1.26.12 Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Auth-Token: gAAAAABjGt2IOwqgpRP4wCTOGHjzuatqxiUXtq3ZLBZCMsBm0jWW1xejAfkoR1kJnUOdzMgEiiLZ6JoHah8D8jnKXlpPoCFy1l8pKsupTtr_uyAgRsBBzFtUQNjKXAxFyeLfK3mODX61vCBAQowI0wQkYMvw7rvlX6cL4gXReSbMDteGICR_Kxo Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Id: None Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Domain-Name: None Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Identity-Status: Confirmed Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Is-Admin-Project: True Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Id: default Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Domain-Name: Default Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Project-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Role: reader,member Sep 09 06:39:11.633863 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Roles: reader,member Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Id: default Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Domain-Name: Default Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Id: 472b6623f57a41568fe7ffce8e40e350 Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: X-User-Name: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: method: > Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: exception: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.635537 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: action_args: {'id': 'be567a31-4455-4dc6-8be1-937ae81a8dbb'} Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:39:11.637401 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.639034 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.640754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Returning 404 to user: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. {{(pid=120795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:39:11.640754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e6255a0b-4408-4734-baff-ed22241ad721 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 404 len: 111 microversion: 2.1 time: 0.030823 Sep 09 06:39:11.640754 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 540/1070] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:39:11 2022] DELETE /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:39:11.644483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:11.645087 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] [instance: be567a31-4455-4dc6-8be1-937ae81a8dbb] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:11.650988 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.651471 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.652046 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.652732 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:11.653190 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:11.653614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:11.666558 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] HTTP exception thrown: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Request method failure captured: Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb HTTP/1.1 Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt2IOwqgpRP4wCTOGHjzuatqxiUXtq3ZLBZCMsBm0jWW1xejAfkoR1kJnUOdzMgEiiLZ6JoHah8D8jnKXlpPoCFy1l8pKsupTtr_uyAgRsBBzFtUQNjKXAxFyeLfK3mODX61vCBAQowI0wQkYMvw7rvlX6cL4gXReSbMDteGICR_Kxo Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:39:11.668053 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/09397aeb58f44f7c9f0ab921e471079a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 09397aeb58f44f7c9f0ab921e471079a Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestVolumeBootPattern-1984049509 Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: 472b6623f57a41568fe7ffce8e40e350 Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestVolumeBootPattern-1984049509-project Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.669717 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'be567a31-4455-4dc6-8be1-937ae81a8dbb'} Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:39:11.670686 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. Sep 09 06:39:11.672264 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:39:11.673699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Returning 404 to user: Instance be567a31-4455-4dc6-8be1-937ae81a8dbb could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:39:11.673699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d5e5cf51-cbed-4660-a618-149519e8d8e9 tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb" status: 404 len: 111 microversion: 2.1 time: 0.028657 Sep 09 06:39:11.673699 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 531/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:11 2022] GET /compute/v2.1/servers/be567a31-4455-4dc6-8be1-937ae81a8dbb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:39:12.971501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a7363aab-d815-4084-a241-4902dbee08ba tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] Calling method '.version_select at 0x7f74ad03c550>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:12.991339 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a7363aab-d815-4084-a241-4902dbee08ba tempest-TestVolumeBootPattern-1984049509 tempest-TestVolumeBootPattern-1984049509-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2075716063" status: 202 len: 0 microversion: 2.1 time: 0.023914 Sep 09 06:39:12.991967 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 541/1072] 10.222.0.25 () {58 vars in 1263 bytes} [Fri Sep 9 06:39:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2075716063 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:39:23.221975 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:39:23.224416 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:23.227654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=35 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:39:23.228483 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=77 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:39:23.233210 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:23.233705 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:23.234143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:23.234856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:23.235314 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:23.235774 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:23.306749 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-15819bbf-d855-452e-8937-7b6b20ec92fa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.089014 Sep 09 06:39:23.307359 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 532/1073] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:39:23 2022] POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:39:23.313040 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:39:23.314416 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:39:23.318308 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:23.318915 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:23.327477 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:23.327998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:23.328431 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:23.329121 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:23.329580 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:23.330003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:23.792796 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:23.800751 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-41c3db26-627d-4a92-a8d1-522c139218ee tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1751 microversion: 2.1 time: 0.489235 Sep 09 06:39:23.801316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 542/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:23 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1751 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:24.824990 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:24.825594 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:24.831722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:24.832213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:24.832651 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:24.833345 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:24.833806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:24.834233 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:24.981038 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:24.989300 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5b3375ed-696a-4581-80b5-a2795667c026 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.169172 Sep 09 06:39:24.989871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 533/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:24 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:26.012564 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:26.013174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:26.019526 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:26.020033 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:26.020462 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:26.021143 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:26.021598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:26.022017 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:26.163909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:26.172756 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-82120b2f-2159-465a-b21b-93801154ee61 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.164119 Sep 09 06:39:26.173330 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:26 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:27.196996 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:27.197597 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:27.204862 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:27.205349 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:27.205785 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:27.206478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:27.206940 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:27.207366 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:27.404723 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:27.412894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-64a37ae6-f015-4024-8021-3e7aef426ec5 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.219783 Sep 09 06:39:27.413456 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 534/1077] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:27 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:28.436514 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:28.437116 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:28.443465 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:28.443974 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:28.444398 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:28.445074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:28.445525 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:28.445937 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:28.588511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:28.597800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a66a72f8-cff0-4c91-a641-3e255570d94c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.165470 Sep 09 06:39:28.598368 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 544/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:28 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:29.621284 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:29.621888 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:29.628356 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:29.628835 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:29.629262 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:29.629939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:29.630391 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:29.630809 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:29.774451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:29.783449 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1b6a7a3c-cffa-4eee-9e7b-a8215e4d5765 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.166286 Sep 09 06:39:29.784033 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 535/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:29 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:30.806156 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:30.806684 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:30.813632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:30.814113 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:30.814544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:30.815228 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:30.815704 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:30.816117 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:30.963691 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:30.972375 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-0f67ba0a-70b9-4a9c-a69d-8fcfa9e573d1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.170123 Sep 09 06:39:30.972941 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 545/1080] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:30 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:31.995088 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:31.995817 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:32.002270 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:32.002757 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:32.003188 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:32.003906 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:32.004364 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:32.004786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:32.148573 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:32.157253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1c7c7578-d096-4603-9e0c-736869ca42c6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.166219 Sep 09 06:39:32.157804 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 536/1081] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:31 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:33.180245 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:33.180858 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:33.187256 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:33.187789 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:33.188231 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:33.188919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:33.189379 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:33.189802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:33.333534 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:33.342316 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ed0f3590-1261-4a07-af78-2b17cc3a3c0f tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.165848 Sep 09 06:39:33.342855 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 546/1082] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:33 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:34.365839 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:34.366459 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:34.373739 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:34.374231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:34.374672 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:34.375369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:34.375871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:34.376300 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:34.516448 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:34.524604 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-65348064-cda3-415c-84eb-c531b6074d50 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.162678 Sep 09 06:39:34.525163 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 537/1083] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:34 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:39:35.548172 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:35.548633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:35.554954 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:35.555432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:35.555897 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:35.556577 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:35.557532 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:35.558098 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:35.709196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:35.717991 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-b6d91424-e14b-464e-bf26-76f27595a0a1 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1756 microversion: 2.1 time: 0.173783 Sep 09 06:39:35.718620 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 547/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:35 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:39:36.742974 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:39:36.743608 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:39:36.750207 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:36.750688 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:36.751119 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:36.751838 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:39:36.752298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:39:36.752721 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:39:36.893047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:39:36.901360 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0a3a2be8-e494-49cd-8177-d0d6f5507701 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1759 microversion: 2.1 time: 0.162152 Sep 09 06:39:36.901856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 538/1085] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:39:36 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:40:10.118591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-265886013"}} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:40:10.119129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:10.121783 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=12 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:40:10.122430 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=36 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:40:10.129084 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:10.129570 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:10.130004 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:10.130693 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:10.131157 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:10.131592 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:10.257444 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.network.security_group_api [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Removing security group 4a3c9396-e843-4d0d-8a3b-fd9d9269ae1c from port 5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 Sep 09 06:40:10.561729 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-725f0d2c-25ac-4c48-85c5-6e36aa9f4f8a tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action" status: 202 len: 0 microversion: 2.1 time: 0.447206 Sep 09 06:40:10.565503 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 548/1086] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:40:10 2022] POST /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:40:10.567243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=14 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:40:10.568192 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:40:10.660253 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:40:10.671027 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:10.671521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:10.671983 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:10.685540 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] Creating event network-changed:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:40:10.691320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-69a6d665-57bd-450e-a66b-520f9703f0ce req-c5c6ab9e-1529-4e85-9c8f-c4ce48480f56 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124577 Sep 09 06:40:10.692387 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 539/1087] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:40:11.869968 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:11.871135 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:11.878482 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:11.879018 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:11.879458 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:11.880219 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:11.880721 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:11.881363 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:11.929916 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:40:11.940101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:11.940856 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:11.941464 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:11.952754 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] Creating event network-changed:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:40:11.957643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-f2634a73-3e0f-42c1-aa86-0d14bb8e553a req-875ee2e6-5eb2-4f41-ae53-f122f2444dfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092620 Sep 09 06:40:11.958577 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 540/1088] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:40:11.968821 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.objects.instance [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lazy-loading 'services' on Instance uuid d8952e95-e5d2-41a7-bc77-5eddd785d6d9 {{(pid=120795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:40:12.047486 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-5d9f1d40-6f7c-4897-a7bb-592b4b71a851 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments/73d3ff22-5b5f-4158-a008-e612a002dd63" status: 202 len: 0 microversion: 2.1 time: 0.188075 Sep 09 06:40:12.051437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 549/1089] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:40:11 2022] DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments/73d3ff22-5b5f-4158-a008-e612a002dd63 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:40:12.057679 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:12.061174 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:12.068751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:12.069305 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:12.070465 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:12.071197 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:12.072277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:12.072805 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:12.112989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-17fa63ae-a9da-4993-bd52-f5c0b39e984e tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059686 Sep 09 06:40:12.118970 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 541/1090] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:40:12 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:40:13.127999 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:13.130302 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:13.136591 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:13.137074 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:13.137507 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:13.138199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:13.138657 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:13.139082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:13.167354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-398b71fd-4961-415e-ae60-f4a02f4e546c tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044170 Sep 09 06:40:13.167891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 550/1091] 10.222.0.25 () {58 vars in 1302 bytes} [Fri Sep 9 06:40:13 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 06:40:13.178985 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:13.179526 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:13.185901 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:13.186440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:13.186873 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:13.187566 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:13.188050 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:13.188472 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:13.261561 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] HTTP exception thrown: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 is not attached to volume 73d3ff22-5b5f-4158-a008-e612a002dd63 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Request method failure captured: Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments/73d3ff22-5b5f-4158-a008-e612a002dd63 HTTP/1.1 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt9GDcflnLp_NSPPRWdDUZq0ONTFsxqn95fbvz8nGNQC6T0WYWSF6mGjDE3ZfX8uzyn5cOEcEP86BOq78cxKeR7bP1dMz2yazHnIrwOMhQmfQeAdvL7hyasnOrP9nzp0JfPGp21LTZMbVrDOJE304nKpIbL-sNHHChWX386bYGBjHDs Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 3312523776514be3a56e169c9234168b Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:40:13.263989 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3312523776514be3a56e169c9234168b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3312523776514be3a56e169c9234168b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3312523776514be3a56e169c9234168b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3312523776514be3a56e169c9234168b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 3312523776514be3a56e169c9234168b Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestMinimumBasicScenario-1113137216-project Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: baef9538b75b4244b6ccf0922af7e5b1 Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestMinimumBasicScenario-1113137216-project Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:40:13.265845 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 is not attached to volume 73d3ff22-5b5f-4158-a008-e612a002dd63 Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'server_id': 'd8952e95-e5d2-41a7-bc77-5eddd785d6d9', 'id': '73d3ff22-5b5f-4158-a008-e612a002dd63'} Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 73d3ff22-5b5f-4158-a008-e612a002dd63. Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:40:13.267101 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 is not attached to volume 73d3ff22-5b5f-4158-a008-e612a002dd63 Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 is not attached to volume 73d3ff22-5b5f-4158-a008-e612a002dd63 Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:13.268918 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Returning 404 to user: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 is not attached to volume 73d3ff22-5b5f-4158-a008-e612a002dd63 {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:40:13.270226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d7581862-4e7a-44f4-a120-e38ddda283a3 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments/73d3ff22-5b5f-4158-a008-e612a002dd63" status: 404 len: 154 microversion: 2.1 time: 0.090368 Sep 09 06:40:13.270226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 542/1092] 10.222.0.25 () {58 vars in 1416 bytes} [Fri Sep 9 06:40:13 2022] DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9/os-volume_attachments/73d3ff22-5b5f-4158-a008-e612a002dd63 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:40:14.407003 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:14.407500 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:14.413800 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:14.414284 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:14.414724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:14.415407 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:14.415889 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:14.416307 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:14.440722 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:40:14.515843 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-cbf81280-398f-4696-9556-0dc110b04ee6 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 204 len: 0 microversion: 2.1 time: 0.112207 Sep 09 06:40:14.516437 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 551/1093] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:40:14 2022] DELETE /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:40:14.526291 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:14.527121 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:14.533654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:14.534128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:14.534554 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:14.535231 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:14.535722 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:14.536141 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:14.666319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:40:14.675324 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f15356c9-f1bf-4f8c-9974-18fe0ed242a4 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1554 microversion: 2.1 time: 0.154150 Sep 09 06:40:14.675915 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 543/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:40:14 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:40:15.699608 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:15.700241 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:15.706230 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:15.706713 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:15.707146 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:15.707857 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:15.708317 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:15.708739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:15.836147 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:40:15.844374 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7ddccf63-c47e-4e98-b810-a56eca48cafa tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1554 microversion: 2.1 time: 0.149310 Sep 09 06:40:15.844944 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 552/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:40:15 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:40:16.867480 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:16.868764 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:16.875818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:16.876300 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:16.876726 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:16.877411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:16.877866 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:16.878281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:17.102316 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baef9538b75b4244b6ccf0922af7e5b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312523776514be3a56e169c9234168b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:40:17.107739 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8952e95-e5d2-41a7-bc77-5eddd785d6d9", "name": "network-vif-deleted", "tag": "5e30e4a1-b196-4f98-bfaf-2bf7a95188a4"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:40:17.111432 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-ac069729-2379-401e-b34a-2bd7c2ad34e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 200 len: 1554 microversion: 2.1 time: 0.247875 Sep 09 06:40:17.112040 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 544/1096] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:40:16 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:40:17.125499 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:17.126067 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:17.126582 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:17.138030 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] Creating event network-vif-deleted:5e30e4a1-b196-4f98-bfaf-2bf7a95188a4 for instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 on hv-cinder-85220 Sep 09 06:40:17.142589 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-4e23a9cd-61f7-4d65-acdb-295a5bd06907 req-a282c957-2499-424e-b50f-b7ba8b8f6b69 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046717 Sep 09 06:40:17.143182 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 553/1097] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:40:18.136797 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:18.137408 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] [instance: d8952e95-e5d2-41a7-bc77-5eddd785d6d9] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:40:18.143876 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:18.144362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:18.144795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:18.145482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:40:18.145939 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:40:18.146384 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:40:18.160017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] HTTP exception thrown: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Request method failure captured: Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 HTTP/1.1 Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt9GDcflnLp_NSPPRWdDUZq0ONTFsxqn95fbvz8nGNQC6T0WYWSF6mGjDE3ZfX8uzyn5cOEcEP86BOq78cxKeR7bP1dMz2yazHnIrwOMhQmfQeAdvL7hyasnOrP9nzp0JfPGp21LTZMbVrDOJE304nKpIbL-sNHHChWX386bYGBjHDs Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 3312523776514be3a56e169c9234168b Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:40:18.161544 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3312523776514be3a56e169c9234168b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3312523776514be3a56e169c9234168b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3312523776514be3a56e169c9234168b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3312523776514be3a56e169c9234168b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 3312523776514be3a56e169c9234168b Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1113137216 Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestMinimumBasicScenario-1113137216-project Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: baef9538b75b4244b6ccf0922af7e5b1 Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestMinimumBasicScenario-1113137216-project Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. Sep 09 06:40:18.163297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'd8952e95-e5d2-41a7-bc77-5eddd785d6d9'} Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:40:18.164507 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. Sep 09 06:40:18.166179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:40:18.168191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Returning 404 to user: Instance d8952e95-e5d2-41a7-bc77-5eddd785d6d9 could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:40:18.168191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-1b3b4168-0883-4faa-b21e-8beca12281e8 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9" status: 404 len: 111 microversion: 2.1 time: 0.030002 Sep 09 06:40:18.168191 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 545/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:40:18 2022] GET /compute/v2.1/servers/d8952e95-e5d2-41a7-bc77-5eddd785d6d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:40:18.173259 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-03f2de0e-1351-4514-bdbe-264dd1af16e0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] Calling method '.version_select at 0x7f74ad1cfca0>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:40:18.191199 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-03f2de0e-1351-4514-bdbe-264dd1af16e0 tempest-TestMinimumBasicScenario-1113137216 tempest-TestMinimumBasicScenario-1113137216-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-241080136" status: 202 len: 0 microversion: 2.1 time: 0.023125 Sep 09 06:40:18.191788 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 554/1099] 10.222.0.25 () {58 vars in 1269 bytes} [Fri Sep 9 06:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-241080136 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:41:01.868535 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:41:01.869128 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:01.872042 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=14 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:01.872708 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=30 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:01.878319 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:01.878800 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:01.879226 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:01.879948 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:01.880399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:01.880818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:01.904962 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.objects.instance [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lazy-loading 'flavor' on Instance uuid be8292f5-aba8-47e7-ab6a-6e5ea3588d0f {{(pid=120797) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 06:41:01.975596 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6b026f06-b61b-4fb7-ad5c-079e206d7c3e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "POST /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f/action" status: 202 len: 0 microversion: 2.1 time: 0.110952 Sep 09 06:41:01.976173 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 546/1100] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:41:01 2022] POST /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:41:01.982653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:01.983517 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:01.987446 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:01.988174 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:01.999632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:02.000125 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:02.000726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:02.001438 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:02.001891 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:02.002353 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:02.138452 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:02.146144 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-ef472838-5345-41df-a737-96d500e34f1d tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.165148 Sep 09 06:41:02.146707 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 555/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:01 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:03.169292 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:03.170023 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:03.176700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:03.177193 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:03.177630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:03.178331 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:03.178796 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:03.179220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:03.309016 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:03.316729 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-3207335b-068e-4fd5-af78-1f043e11921b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.151816 Sep 09 06:41:03.317296 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 547/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:03 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:04.341909 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:04.342455 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:04.348994 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:04.349475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:04.349901 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:04.350581 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:04.351031 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:04.351450 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:04.485066 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:04.492744 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-241a67ac-6311-40c4-a7a7-d2cd53372f7b tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.155768 Sep 09 06:41:04.493314 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 556/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:04 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 06:41:05.516664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:05.517283 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:05.523664 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:05.524148 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:05.524581 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:05.525266 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:05.525727 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:05.526152 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:05.655768 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:05.664248 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-5c72909e-8c03-4d1c-a2cd-b86158412f01 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.152095 Sep 09 06:41:05.664818 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 548/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:05 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:06.688045 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:06.688666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:06.694985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:06.695475 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:06.695952 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:06.696639 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:06.697097 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:06.697516 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:06.830737 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:06.838390 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-be2e5668-1906-4e81-a76d-19af47500cfa tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.154424 Sep 09 06:41:06.838955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 557/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:06 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:07.863819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:07.864410 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:07.872801 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:07.873290 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:07.873730 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:07.874430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:07.875811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:07.876513 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:08.011871 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:08.021318 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d01538e9-89fa-4c8b-86db-6fc2bb9518e5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.163130 Sep 09 06:41:08.021925 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 549/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:07 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:09.044253 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:09.044851 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:09.051441 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:09.051955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:09.052382 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:09.053057 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:09.053522 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:09.053919 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:09.188799 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:09.196496 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-841a245a-4afe-42d4-9bef-42640d32d44c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.156061 Sep 09 06:41:09.197064 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 558/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:09 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:10.221179 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:10.221865 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:10.228113 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:10.228593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:10.229022 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:10.229700 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:10.230151 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:10.230567 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:10.360058 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:10.367765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-7d72e995-1888-4730-a245-8ea435053019 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.151630 Sep 09 06:41:10.368321 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 550/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:10 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:11.391330 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:11.392035 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:11.398427 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:11.398903 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:11.399336 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:11.400052 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:11.400509 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:11.400929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:11.534136 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:11.541726 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-51f200ae-27a5-4f98-9d71-4c58d0d10d6e tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.154480 Sep 09 06:41:11.542319 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 559/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:11 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:12.564770 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:12.565414 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:12.572156 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:12.572652 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:12.573091 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:12.573795 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:12.574259 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:12.574685 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:12.766834 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:12.774639 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-6dd7dd49-fcf5-4425-87d6-e645cfc46cc7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.214356 Sep 09 06:41:12.775215 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 551/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:12 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:13.798712 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:13.799261 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:13.806018 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:13.806504 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:13.806947 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:13.807648 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:13.808109 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:13.808530 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:13.939346 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:13.947201 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-87c8f5a8-ae87-473e-9622-3c95a8959fa6 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.153067 Sep 09 06:41:13.947798 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 560/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:13 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:14.972092 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:14.973751 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:14.980426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:14.980893 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:14.981322 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:14.982010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:14.982469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:14.982886 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:15.122971 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:15.131354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-0453eb64-1d26-4730-b0c1-b8cc75a3cc6c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.164332 Sep 09 06:41:15.131881 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 552/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:14 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:16.155051 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:16.155692 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:16.162541 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:16.163029 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:16.163493 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:16.164206 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:16.164668 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:16.165089 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:16.295122 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:16.302810 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-6d720685-3951-4512-850b-a357e62b4477 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1509 microversion: 2.1 time: 0.151624 Sep 09 06:41:16.303383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 561/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:16 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:16.325045 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:41:16.325634 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:16.332525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:16.333011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:16.333440 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:16.334208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:16.334665 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:16.335085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:16.363077 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120797) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 06:41:16.423669 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [127cc0ed-f1d8-4f4e-847f-b145e9a6eecb] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 06:41:17.430572 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO oslo.messaging._drivers.impl_rabbit [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [127cc0ed-f1d8-4f4e-847f-b145e9a6eecb] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36462. Sep 09 06:41:17.434287 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d32b6331-e220-43f2-b332-c26a486a367a tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "POST /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f/action" status: 202 len: 0 microversion: 2.1 time: 1.113167 Sep 09 06:41:17.434905 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 553/1114] 10.222.0.25 () {60 vars in 1278 bytes} [Fri Sep 9 06:41:16 2022] POST /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f/action => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 06:41:17.443153 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:17.443816 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:17.450135 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:17.450624 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:17.451055 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:17.451767 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:17.452224 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:17.452765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:17.587966 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:17.596547 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-592b4b20-ddd0-4deb-bc17-631f3dd90d6f tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1517 microversion: 2.1 time: 0.157165 Sep 09 06:41:17.597112 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 562/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:17 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:17.895297 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "name": "network-vif-unplugged", "status": "completed", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:41:17.905783 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:17.906265 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:17.906710 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:17.919362 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.compute.server_external_events [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] Unable to find a host for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f. Dropping event network-vif-unplugged {{(pid=120797) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 06:41:17.920482 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-89bf0ab2-d1c2-4081-80ee-cb726efdda47 req-8438b740-1100-4995-9ae7-64c1e8f3150e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097396 Sep 09 06:41:17.921220 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 554/1116] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 99 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 06:41:18.620251 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:18.620861 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:18.628618 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:18.629111 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:18.629544 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:18.630243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:18.630765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:18.631221 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:18.768065 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:18.775794 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-64c740de-60fc-4f2a-a058-34cc72e2df94 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1519 microversion: 2.1 time: 0.159511 Sep 09 06:41:18.776365 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 563/1117] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:18 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:19.798976 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:19.799610 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:19.806351 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:19.807017 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:19.807643 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:19.808369 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:19.808831 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:19.809258 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:19.977493 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:19.985740 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-83d8d6df-0d40-43c3-bbbd-b6b2d377bfef tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.191392 Sep 09 06:41:19.986405 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 555/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:19 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:21.008958 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:21.009594 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:21.016664 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:21.017158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:21.017590 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:21.018279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:21.018738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:21.019158 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:21.148898 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:21.156560 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-e4930354-e89c-4eae-961f-b1b1deb8ea0c tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.151473 Sep 09 06:41:21.157196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 564/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:21 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:22.179451 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:22.180085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:22.186411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:22.186899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:22.187332 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:22.188895 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:22.189361 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:22.189786 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:22.320399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:22.328010 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-cd3836be-1eac-460a-9207-9a5c305044e7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.152430 Sep 09 06:41:22.328587 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 556/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:22 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:23.351383 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:23.352023 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:23.358324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:23.358802 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:23.359225 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:23.360059 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:23.360697 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:23.361138 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:23.491460 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:23.499168 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-60909aeb-f11d-4c36-ad30-73d7ed963961 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.151725 Sep 09 06:41:23.499762 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 565/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:23 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:24.522802 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:24.523599 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:24.530080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:24.530579 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:24.531011 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:24.532399 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:24.532859 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:24.533283 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:24.660999 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:24.668630 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-d1782804-1393-4891-8cb9-e8003c52e0c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.149756 Sep 09 06:41:24.669187 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 557/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:24 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:25.691743 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:25.692344 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:25.698848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:25.699325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:25.699793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:25.700501 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:25.700950 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:25.701364 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:25.834060 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:25.841748 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-8b9320f2-e77d-4033-a6fe-1e7656acfc77 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.154090 Sep 09 06:41:25.842325 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 566/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:25 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:26.865889 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:26.866426 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:26.872894 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:26.873378 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:26.873811 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:26.874497 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:26.874959 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:26.875383 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:27.010098 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:27.017951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-f6aa0c93-353d-4a8e-8d7c-6acff79b82f0 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.155991 Sep 09 06:41:27.018511 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 558/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:26 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:28.041466 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:28.042072 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:28.048955 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:28.049435 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:28.049861 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:28.050535 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:28.050985 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:28.051403 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:28.187002 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:28.195470 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-3171200f-cc83-49c0-ab40-ad82d482a7c7 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.157877 Sep 09 06:41:28.196063 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 567/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:28 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:29.217969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:29.218556 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:29.225561 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:29.226047 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:29.226481 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:29.227166 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:29.227645 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:29.228078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:29.358041 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:29.365819 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8bc26fce-c3c1-4a81-a41e-18b567897bbb tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.151713 Sep 09 06:41:29.366382 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 559/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:29 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:29.903865 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "name": "network-vif-plugged", "status": "completed", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:41:29.914633 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:29.915123 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:29.915560 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:29.930042 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.compute.server_external_events [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] Creating event network-vif-plugged:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:41:29.935166 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [req-f1a7a6b7-5b5e-42f8-96ec-0eff6c4dbe6c req-13bf3960-8c80-4337-9fa4-1d1f9e5113e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034975 Sep 09 06:41:29.935793 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 568/1127] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:41:30.388828 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:30.389470 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:30.396654 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:30.397147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:30.397588 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:30.398281 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:30.398746 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:30.399178 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:30.403277 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:30.530354 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:30.538715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-b0c0cae4-220e-4ac0-9ff3-e1acd08b33a1 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.153798 Sep 09 06:41:30.539272 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 560/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:30 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:31.562653 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:31.563946 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:31.570342 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:31.570840 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:31.571279 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:31.572008 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:31.572568 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:31.572998 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:31.710432 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:31.718271 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-61ca4bb5-0bbe-4a14-a208-516bb08700a8 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1575 microversion: 2.1 time: 0.160877 Sep 09 06:41:31.718848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 569/1129] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:31 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:41:32.741298 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:41:32.741899 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:41:32.744208 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:41:32.749320 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:32.749806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:32.750237 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:32.750921 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:41:32.751521 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:41:32.751963 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:41:32.886941 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:41:32.895469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-a8030d39-3e57-4f8d-b2d5-440d4f7c54be tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1562 microversion: 2.1 time: 0.157987 Sep 09 06:41:32.896080 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 561/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:41:32 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:42:49.632738 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_api:SELECT=30 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:42:49.633502 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG dbcounter [-] [120795] Writing DB stats nova_cell1:SELECT=86 {{(pid=120795) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:42:49.634556 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 06:42:49.634695 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Fri Sep 9 06:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f (ip 10.222.0.25) !!! Sep 09 06:42:49.635268 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_api:SELECT=1 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:42:49.636471 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 06:42:49.636784 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: Fri Sep 9 06:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f (ip 10.222.0.25) !!! Sep 09 06:42:49.638303 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG dbcounter [-] [120797] Writing DB stats nova_cell1:SELECT=10 {{(pid=120797) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 06:42:49.639715 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 06:42:49.640143 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Fri Sep 9 06:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Sep 09 06:42:49.642678 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:49.643227 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:42:49.648773 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:42:49.652963 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:49.653312 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:49.653747 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:49.654575 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:49.654905 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:49.655323 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:49.673213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:49.673213 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:49.674164 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:49.684619 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Going to try to terminate instance {{(pid=120795) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 06:42:49.685969 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] Creating event network-changed:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:42:49.691984 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-26118a8e-9ddd-4622-b48c-3a921a86c2e2 req-2c7b3955-7862-4b08-a13d-00504a314c07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059115 Sep 09 06:42:49.692765 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 562/1131] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 06:42:49.771912 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-d02f564a-475a-4d99-8109-0ec4d33f4885 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "DELETE /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 204 len: 0 microversion: 2.1 time: 0.140995 Sep 09 06:42:49.775641 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 570/1132] 10.222.0.25 () {58 vars in 1239 bytes} [Fri Sep 9 06:42:49 2022] DELETE /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 06:42:49.782593 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:49.783469 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:42:49.789902 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:49.790478 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:49.791243 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:49.791792 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:49.792333 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:49.792806 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:49.962132 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.policy [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120797) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:42:49.971411 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-8c0638db-8f3e-4b3e-ab19-06f9f04cac67 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.192985 Sep 09 06:42:49.972085 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 563/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:42:49 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:42:50.995632 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:50.996335 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:42:51.003829 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:51.004324 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:51.004765 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:51.005468 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:51.005929 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:51.006354 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:51.168848 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:42:51.177724 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-a814c213-69e9-4a7a-acb5-1b5edbceb629 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1568 microversion: 2.1 time: 0.186424 Sep 09 06:42:51.184595 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 571/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:42:50 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:42:52.024078 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be8292f5-aba8-47e7-ab6a-6e5ea3588d0f", "name": "network-vif-deleted", "tag": "c8736539-8e31-4f7a-8a21-d7d0a6bc130d"}]} {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 06:42:52.034018 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:52.034502 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:52.034936 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:52.046430 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.compute.server_external_events [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] Creating event network-vif-deleted:c8736539-8e31-4f7a-8a21-d7d0a6bc130d for instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f on hv-cinder-85220 Sep 09 06:42:52.052250 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [req-fabf4500-fc82-457c-a23b-e268d82bee93 req-533fc0b0-56c1-4f47-8a63-291bb2b922f9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Sep 09 06:42:52.052854 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 564/1135] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Sep 9 06:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 06:42:52.202243 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:52.202847 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.compute.api [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120795) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:42:52.209598 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:52.210082 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:52.210511 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:52.211196 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:52.211677 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:52.212101 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG oslo_concurrency.lockutils [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:52.275355 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.policy [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b84d34323691437b9e2e9e99c29db0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d1fbee4bc4dbeb359f463302be8ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120795) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 06:42:52.284129 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-aa51ec79-4c8f-4fb8-a246-cdc0596d26b5 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 200 len: 1219 microversion: 2.1 time: 0.085564 Sep 09 06:42:52.284832 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 572/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:42:52 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 06:42:53.307917 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '>' {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:53.308532 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.compute.api [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] [instance: be8292f5-aba8-47e7-ab6a-6e5ea3588d0f] Fetching instance by UUID {{(pid=120797) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 06:42:53.315402 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:53.315920 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:53.316368 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:53.317060 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Acquiring lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 06:42:53.317525 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 06:42:53.317951 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG oslo_concurrency.lockutils [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Lock "c899fb98-16f2-46e4-8e27-e32c68678e5e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120797) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 06:42:53.331516 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.wsgi [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] HTTP exception thrown: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Request method failure captured: Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: request: GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f HTTP/1.1 Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept: application/json Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Accept-Encoding: identity Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Connection: close Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Length: 0 Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Content-Type: application/json Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Host: 10.222.0.25 Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: Openstack-System-Scope: None Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: User-Agent: python-urllib3/1.26.12 Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Auth-Token: gAAAAABjGt9URDu-o3Ad7A9XpD8N7c965XnKeGI5rTle74csg8LcKc0i0pB7yzq2xVmN_Xat1Mmg1r_Cp6_wNwt1k1d3sD-vv_jdSUT7KVlrNhzweGJt0TFeWHm5pnIsP-eh07A_pCl6X4APj89fg4BV7Ze0s5O6Wq72B0qYkn7gwOSFngMtkDY Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Id: None Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Domain-Name: None Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Identity-Status: Confirmed Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Is-Admin-Project: True Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Id: default Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Domain-Name: Default Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Id: 240d1fbee4bc4dbeb359f463302be8ee Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Project-Name: tempest-TestShelveInstance-695708215 Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Role: reader,member Sep 09 06:42:53.333147 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Roles: reader,member Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/240d1fbee4bc4dbeb359f463302be8ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_240d1fbee4bc4dbeb359f463302be8ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/240d1fbee4bc4dbeb359f463302be8ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/240d1fbee4bc4dbeb359f463302be8ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}] Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant: tempest-TestShelveInstance-695708215 Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Id: 240d1fbee4bc4dbeb359f463302be8ee Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-Tenant-Name: tempest-TestShelveInstance-695708215 Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User: tempest-TestShelveInstance-695708215-project Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Id: default Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Domain-Name: Default Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Id: b84d34323691437b9e2e9e99c29db0f1 Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: X-User-Name: tempest-TestShelveInstance-695708215-project Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: method: > Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: exception: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. Sep 09 06:42:53.335012 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: action_args: {'id': 'be8292f5-aba8-47e7-ab6a-6e5ea3588d0f'} Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: {{(pid=120797) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 06:42:53.336169 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. Sep 09 06:42:53.337914 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: ERROR nova.api.openstack.wsgi Sep 09 06:42:53.339614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: DEBUG nova.api.openstack.wsgi [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Returning 404 to user: Instance be8292f5-aba8-47e7-ab6a-6e5ea3588d0f could not be found. {{(pid=120797) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 06:42:53.339614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: INFO nova.api.openstack.requestlog [None req-60dbce9d-7d16-494c-830c-d2dfeef7cf30 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f" status: 404 len: 111 microversion: 2.1 time: 0.031423 Sep 09 06:42:53.339614 dv-cinder-852209-16-iscsi devstack@n-api.service[120797]: [pid: 120797|app: 0|req: 565/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Fri Sep 9 06:42:53 2022] GET /compute/v2.1/servers/be8292f5-aba8-47e7-ab6a-6e5ea3588d0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 06:42:53.492666 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: DEBUG nova.api.openstack.wsgi [None req-7f7d3d5d-653c-4d0f-88b4-2c7170995a52 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] Calling method '.version_select at 0x7f74ad01a940>' {{(pid=120795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 06:42:53.515839 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: INFO nova.api.openstack.requestlog [None req-7f7d3d5d-653c-4d0f-88b4-2c7170995a52 tempest-TestShelveInstance-695708215 tempest-TestShelveInstance-695708215-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-366509566" status: 202 len: 0 microversion: 2.1 time: 0.026333 Sep 09 06:42:53.516461 dv-cinder-852209-16-iscsi devstack@n-api.service[120795]: [pid: 120795|app: 0|req: 573/1138] 10.222.0.25 () {58 vars in 1251 bytes} [Fri Sep 9 06:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-366509566 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)